PATENT ABSTRACTS OF JAPAN 
(ll)Publication number : 10-243407 
(43)Date of publication of application : 11.09. 1998 



(5l)Int.Cl. H04N 9/07 



(21) Application number : 09-058568 (7l)Applicant : OLYMPUS OPTICAL CO LTD 

(22) Date of filing : 27.02.1997 (72)Inventor : TSURUOKA TAKEO 
TSUKIOKA TAKETO 



(54) IMAGE SIGNAL PROCESSOR AND IMAGE INPUT PROCESSOR 
(57)Abstract: 

PROBLEM TO BE SOLVED: To decode a missing color signal by extracting a color 
signal in a local area with a prescribed size that includes designated pixels and 
modifying and synthesizing the color signal with less color aberration based on a 
prescribed structural model and a prescribed evaluation function so as to generate a 
reference image based on the produced approximated reference image and the 
approximated reference image after smoothing. 

SOLUTION^ An area extract section 305 conducts image scanning under the control of a 
control section 320 to extract color signals in each color in existence in an area of a 
.prescribed size around a specific pixel and transfers the extracted color signals to signal 
block buffers 306, 307, 308 respectively. Each of mean value. variance calculation 
sections 309, 310, 311 reads each color signal and calculates a mean value and a 
variance of each color signal. A signal modification section 313 modifies the variance 



and the mean value of other color signals than the color signal providing a maximum 
variance so as to be equal to the variance and the mean value of the color signal 
providing the maximum variance as to each color signal which is transferred from an 
RGB switch section 317 and transfers the modified result to an object image generating 
section 314. A missing pixel decoding section 318 decodes a missing color signal and 
provides an output of the result. 
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CLAIMS 



[Claim(s)] 

[Claim l] In the picture signal processor which processes the picture signal with which 
the picture signal which one pixel has consists of two or more chrominance signals, and 
with which at least one or more chrominance signals are missing according to the 
location of a pixel An extract means to extract the chrominance signal of the partial field 



of the predetermined size which includes the specified pixel from the above-mentioned 
picture signal, A chrominance -signal selection means to compute a predetermined 
parameter for every chrominance signal in the partial field extracted with this extract 
means, and to choose one chrominance signal based on this parameter, The deformation 
means which transforms a chrominance signal so that it may become the same as that 
of the parameter of the chrominance signal with which the above-mentioned parameter 
was chosen about chrominance signals other than the chrominance signal chosen with 
this chrominance-signal selection means, A candidate image generation means to 
compound two or more chrominance signals of each which deformed with this 
deformation means, and the chrominance signal chosen by the above-mentioned 
chrominance-signal selection means, and to generate two or more reference candidate 
images, A reference image selection means to choose one reference image from two or 
more reference candidate images generated with this candidate image generation 
means based on a predetermined performance index, The picture signal processor 
characterized by providing a restoration means to restore a missing chrominance signal, 
based on the reference image chosen with the above-mentioned reference image 
selection means. 

[Claim 2] In the image input-process equipment which carries out input process of the 
picture signal with which the picture signal which one pixel has consists of two or more 
chrominance signals, and with which at least one or more chrominance signals are 
missing according to the location of a pixel The input means which consists of an optical 
lens system which produces chromatic aberration, and image pick-up equipment with 
which the frequency of occurrence of a chrominance signal was adjusted based on this 
amount of chromatic aberration, In each chrominance signal in the partial field 
extracted with an extract means to extract the chrominance signal of the partial field of 
the predetermined size which includes the specified pixel from the picture signal 
acquired from this input means, and this extract means An approximation reference 
image generation means to generate an approximation reference image by transforming 
and compounding a chrominance signal with few amounts of chromatic aberration 
based on a predetermined structure model and a predetermined performance index, A 
smoothing means to graduate the approximation reference image generated with this 
approximation reference image generation means based on the amount of chromatic 
aberration of a chrominance signal with many amounts of chromatic aberration, Image 
input-process equipment which generates a reference image based on the 
approximation reference image generated with the above-mentioned approximation 
reference image generation means, and the approximation reference image graduated 



with the above-mentioned smoothing means, and is characterized by providing a 
restoration means to restore a missing chrominance signal. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to a picture signal processor and image 

input-process equipment. 

[0002] 

[Description of the Prior Art] The image input-process equipment using CCD of a veneer 
type cheap and lightweight in recent years has spread. In such image input-process 
equipment, in order to acquire the color information on a photographic subject from the 
image sensor of one sheet, the color filter is arranged in the shape of a mosaic on a 
light-receiving side. 

[0003] As an example of a color filter, arrangement of the complementary color mosaic 
filter which consists of cyanogen (Cy) (Magenta Mg) yellow (Ye) Green (G) is shown in 
drawing 19 . In drawing 19 , the luminance signal corresponding to n lines of the even 
number field, and n+1 line Yo and n, They are Yo, n+1, and a color-difference signal Co, 
n, Co, and n+1 They are Ye, n, Ye, n+1, and a color-difference signal about the 
luminance signal corresponding to [ carry out and ] n lines of the odd number field, and 
n+1 line Ce, n, Ce, and n+1 These signals are shown by the degree type when it carries 
out. 
[0004] 

Yo,n =Yo,n+l =Ye,n =Ye,n+l =2R+3G+2B (l) 
Co.n =Ce,n =2R-G (2) 
Co,n+l =Ce,n+l =2B G (3) 

However, Cy, Mg, and Ye are shown by the degree type by Green (G) and red (R), and 

blue (B). 

[0005] 

Cy=G+B (4) 

Mg=R+B (5) 

Ye=R+G (6) 



(l) As shown in a formula, a luminance signal is generated in all Rhine of even number 
and the odd number field. On the other hand, as shown in (2) and (3) types, two 
color-difference signals are not generated at intervals of a line, but are compensated 
with the color-difference signal of Rhine which is missing with linear interpolation. 
Then, the three primary colors of R, G, and B can be obtained by performing matrix 
operation. By such approach, a color-difference signal has only one half of amount of 
information to a luminance signal, and the artifact called color moire to the edge section 
generates it. Although arranging the low pass filter which used the crystal filter in the 
front face of an image sensor is generally performed in order to reduce such color moire, 
the new problem that resolution falls by insertion of a low pass filter occurs. 
[0006] Moreover, JP,04-62096,A and JP,05"056446,A are indicating the approach of 
amending a color-difference signal using the component of a luminance signal rather 
than perform simple interpolation only with a color-difference signal as mentioned 
above. 

[0007] That is, according to JP,04-62096,A, although a luminance signal Y is created by 
linear interpolation, in the field with little change of a luminance signal Y, it 
compensated with linear interpolation and color-difference-signal C recovered by 
transforming a luminance signal Y as shown in (7) types has been obtained in the large 
field of change about the color- difference signal C. 
[0008] 
C'=aY+b (7) 

a and b are constants here. 

[0009] Moreover, at JP,05'056446,A, although a luminance signal Y is created by linear 
interpolation, it processes a luminance signal Y and a color-difference signal C with an 
electrical circuit-low pass filter about a color-difference signal C, and it is each 
low-frequency component Ylow. Clow It obtained and chrominance -signal C f by which 
lack was recovered using the following (8) types has been obtained. 
[0010] 

[Equation l] 
* Low 

This is a low-frequency component Ylow about a luminance signal Y. Clow It is 
equivalent to making into chrominance-signal C what was used and amended. 
[0011] 

[Problem(s) to be Solved by the Invention] However, although the color-difference signal 



is compensated with the above-mentioned conventional technique for the luminance 
signal by linear interpolation based on linear interpolation or a luminance signal when 
CCD of a veneer type is used, a luminance signal is 1/2 at the time of essentially using 3 
plate type CCD, and cannot restore a missing chrominance signal with high precision by 
such approach. 

[0012] Moreover, with the above-mentioned conventional technique, when the cheap 
optical lens system from which chromatic aberration in which a specific chrominance 
signal deteriorates by such approach produces a luminance signal although the 
color-difference signal is compensated with linear interpolation based on linear 
interpolation or a luminance signal is used, a missing chrominance signal cannot be 
restored with high precision. 

[0013] This invention is made paying attention to such a technical problem, and the 
place made into the purpose is to offer the picture signal processor which can restore a 
missing chrominance signal with high precision. 

[0014] Moreover, other purposes of this invention are to offer the image input-process 
equipment which can restore the chrominance signal which is missing even when a 
cheap optical lens system is used with high precision. 
[0015] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, the 
picture signal processor concerning the 1st invention In the picture signal processor 
which processes the picture signal with which the picture signal which one pixel has 
consists of two or more chrominance signals, and with which at least one or more 
chrominance signals are missing according to the location of a pixel An extract means to 
extract the chrominance signal of the partial field of the predetermined size which 
includes the specified pixel from the above-mentioned picture signal, A 
chrominance-signal selection means to compute a predetermined parameter for every 
chrominance signal in the partial field extracted with this extract means, and to choose 
one chrominance signal based on this parameter, The deformation means which 
transforms a chrominance signal so that it may become the same as that of the 
parameter of the chrominance signal with which the above-mentioned parameter was 
chosen about chrominance signals other than the chrominance signal chosen with this 
chrominance- signal selection means, A candidate image generation means to compound 
.two or more chrominance signals of each which deformed with this deformation means, 
and the chrominance signal chosen by the above-mentioned chrominance-signal 
selection means, and to generate two or more reference candidate images, From two or 
more reference candidate images generated with this candidate image generation 



means, a reference image selection means to choose one reference image based on a 
predetermined performance index, and a restoration means to restore the chrominance 
signal which is missing based on the reference image chosen with the above-mentioned 
reference image selection means are provided. 

[0016] Moreover, the image input-process equipment concerning the 2nd invention In 
the image input-process equipment which carries out input process of the picture signal 
with which the picture signal which one pixel has consists of two or more chrominance 
signals, and with which at least one or more chrominance signals are missing according 
to the location of a pixel The input means which consists of an optical lens system which 
produces chromatic aberration in the above-mentioned image input-process equipment, 
and image pick-up equipment which adjusted the frequency of occurrence of a 
chrominance signal based on the amount of chromatic aberration, In each chrominance 
signal in the partial field extracted with an extract means to extract the chrominance 
signal of the partial field of the predetermined size which includes the pixel as which it 
was specified in the picture signal acquired from this input means, and this extract 
means An approximation reference image generation means to generate an 
approximation reference image by transforming and compounding a chrominance signal 
with few amounts of chromatic aberration based on a predetermined structure model 
and a predetermined performance index, A smoothing means to graduate the 
approximation reference image generated with this approximation reference image 
generation means based on the amount of chromatic aberration of a chrominance signal 
with many amounts of chromatic aberration, A reference image is generated based on 
the approximation reference image generated with the above-mentioned approximation 
reference image generation means, and the approximation reference image graduated 
with the above-mentioned smoothing means, and a restoration means to restore a 
missing chrominance signal is provided. 

[0017] That is, the picture signal which one pixel has consists of two or more 
chrominance signals, and in processing the picture signal with which at least one or 
more chrominance signals are missing according to the location of a pixel, the picture 
signal processor concerning the 1st invention extracts the chrominance signal of the 
partial field of the predetermined size which includes the specified pixel from the 
above -mentioned picture signal first. Next, a predetermined parameter is computed for 
every chrominance signal in the extracted partial field, and one chrominance signal is 
chosen based on this parameter. Next, a chrominance signal is transformed so that it 
may become the same as that of the parameter of the chrominance signal with which 
the above-mentioned parameter was chosen about chrominance signals other than the 



selected chrominance signal. Next, two or more chrominance signals of each which 
deformed, and the selected chrominance signal are compounded, and two or more 
reference candidate images are generated. And from two or more of these generated 
reference candidate images, one reference image is chosen based on a predetermined 
performance index, and a missing chrominance signal is restored based on the selected 
reference image. 

[0018] Moreover, the image input-process equipment concerning the 2nd invention In 
carrying out input process of the picture signal with which the picture signal which one 
pixel has consists of two or more chrominance signals and with which at least one or 
more chrominance signals are missing according to the location of a pixel First, the 
chrominance signal of the partial field of the predetermined size which includes the 
pixel as which it was specified in the picture signal acquired from this input means is 
extracted using the input means which consists of an optical lens system which 
produces chromatic aberration in the above-mentioned image input-process equipment, 
and image pick-up equipment which adjusted the frequency of occurrence of a 
chrominance signal based on the amount of chromatic aberration. Next, an 
approximation reference image is generated by transforming and compounding a 
chrominance signal with few amounts of chromatic aberration in each chrominance 
signal in the extracted partial field based on a predetermined structure model and a 
predetermined performance index. Next, this generated approximation reference image 
is graduated based on the amount of chromatic aberration of a chrominance signal with 
many amounts of chromatic aberration. And a reference image is generated based on 
the generated approximation reference image and the graduated approximation 
reference image, and a missing chrominance signal is restored. 
[0019] 

[Embodiment of the Invention] Below, with reference to a drawing, the operation gestalt 
of this invention is explained at a detail. First, the 1st operation gestalt is explained. 
Drawing 1 is the functional block diagram of the picture signal processor concerning the 
1st operation gestalt, and explains the connection relation of each function below. 
[0020] In drawing 1 , it connects with the buffer 102 for R signals, the buffer 103 for G 
signals, and the buffer 104 for B signals, and the input section 101 is further connected 
to the block buffer 106 for R signals, the block buffer 107 for G signals, and the block 
buffer 108 for B signals through the field extract section 105, respectively. The block 
buffer 107 for G signals is connected to the distributed calculation section 110, the RGB 
change-over section 113, and the signal transformation section 151, and the block buffer 
108 for B signals is connected to the distributed calculation section 109, the RGB 



change-over section 113, and the signal transformation section 151 for the block buffer 
106 for R signals at the distributed calculation section 111, the RGB change-over section 
113, and the signal transformation section 151. The distributed calculation sections 109, 
110, and 111 are connected to the signal transformation section 151 through the 
maximum distribution decision section 150. 

[0021] This signal transformation section 151 is connected to the lack pixel restoration 
section 116 through the buffer 112 for reference images. The RGB change-over section 
113 is connected to the output section 117 through the edge on-the-strength calculation 
section 114, the linear interpolation section 115, or the lack pixel restoration section 116. 
Moreover, the control section 118 is connected to the input section 101, the field extract 
section 105, the distributed calculation sections 109, 110, and 111, the signal 
transformation section 151, the RGB change-over section 113, the edge on-the-strength 
calculation section 114, the lack pixel restoration section 116, and the output section 117. 
[0022] Drawing 2 is drawing showing the above-mentioned concrete configuration of the 
signal transformation section 151, and the block buffer 106 for R signals, the block 
buffer 107 for G signals, the block buffer 108 for B signals, the maximum distribution 
decision section 150, selection section 151A that receives the signal from a control 
section 118, gain bias calculation section 151B, and operation part 151C are connected 
in order. 

[0023] In addition, a part of each above-mentioned function consists of hardware, the 
output section 117 is constituted by the magnetic disk and a control section 118 is 
constituted for the input section 101 from this operation gestalt by the veneer type CCD 
with a microcomputer. 

[0024] Drawing 3 is drawing showing the concrete configuration of the input section 101. 
It is arranged so that a lens system 201, a low pass filter 202, and CCD203 of a veneer 
type can picturize a photographic subject. CCD203 is CCD with filter arrangement of a 
primary color mold which is described below, and is connected to the matrix circuit 209 
through A/D converter 204, the color separation circuit 205, and the process circuits 206, 
. 201, and 208. The output of this matrix circuit 209 is connected to the buffers 102, 103, 
and 104 for RGB 3 signals. Moreover, the CCD drive circuit 211 which drives CCD203 
based on the clock generated by the clock generator 210 is connected to CCD203. 
[0025] Drawing 4 is drawing showing the concrete configuration of the filter 
arrangement in CCD203 of drawing 3 . Here, it is filled up with all the pixels on CCD by 
constituting repetitively basic arrangement of 3x3 size as shown in drawing 4 (a) 
repeatedly, as shown in drawing 3 (b). With this operation gestalt, the frequency of 
occurrence of RGB3 signal is set up so that it may become the equal ratio of l-l^l. 



[0026] An operation of a configuration of being shown in drawing 1 described above 
below is explained with reference to the flow chart of drawing 5 . 

[0027] In drawing 1 , RGB3 signal for one frame is read through the input section 101 
based on control of a control section 118, and is transmitted to the buffer 102 for R 
signals, the buffer 103 for G signals, and the buffer 104 for B signals (step Si). Next, the 
field extract section 105 scans an image based on control of a control section 118 (step 
S2). From each chrominance signal for one frame in each buffer 102,103,104 for 
chrominance signals The chrominance signal which exists in the rectangle field of the 
predetermined size centering on a certain specific pixel, for example, the field of 5x5 size, 
is extracted (step S3), and it transmits to the block buffer 106 for R signals, the block 
buffer 107 for G signals, and the block buffer 108 for B signals, respectively. The RGB 
change-over section 113 is beginning to read the chrominance signal of the rectangle 
field in each block buffer 106,107,108 one by one based on control of a control section 
118, and transmits it to the edge on-the-strength calculation section 114. On the radical 
of control of a control section 118, the edge on-the-strength calculation section 114 
computes the edge reinforcement based on Laplacian from all chrominance signals (step 
S4), it judges whether edge reinforcement is larger than a predetermined threshold (for 
example, let 8 be a threshold when a signal is the 8-bit precision of 0-255) (step S5), in 
YES, the lack pixel restoration section 116 is chosen, and, in NO, the linear 
interpolation section 115 is chosen. 

[0028] And when the linear interpolation section 115 is chosen, a lack pixel is restored 
by the well-known linear interpolation approach, and it outputs to the exterior from the 
output section 117 (steps S16 and S17). Moreover, when the lack pixel restoration 
section 116 is chosen, processing shifts to the distributed calculation sections 109, 110, 
and 111 through a control section 118. Namely, the distributed calculation sections 109, 
110, and 111 compute distribution of each chrominance signal based on control of a 
control section 118 by reading each chrominance signal of each block buffers 106 and 
107 and the rectangle field in 108. Next, the maximum distribution decision section 150 
determines the chrominance signal which has the greatest distribution among each 
computed distribution (step S6). 

[0029] Selection section 151A ( drawing 2 ) of the signal transformation section 151 
chooses one of each chrominance signals of the rectangle field in each block buffer 
.106,107,108 based on control of a control section 118 by whether it is the signal with 
which the chrominance signal from the maximum distribution decision section 150 has 
the maximum distribution (step S7). That is, the chrominance signal corresponding to 
the maximum distribution is outputted to the buffer 112 for reference images among 



each chrominance signal of the rectangle field in each block buffer 106,107,108, without 
deforming. About what is not the chrominance signal of the maximum distribution, it is 
outputted to gain bias calculation section 151B. Gain bias calculation section 151B is 
gain alphai about the inputted chrominance signal. Bias betai It computes (step S8) and 
outputs to operation part 15 1C with the chrominance signal I concerned. Operation part 
15 1C is computed gain alphai. Bias betai It uses, the chrominance signal concerned is 
transformed and it outputs to the reference image buffer 112 (step S9). A reference 
image is generated by integrating the chrominance signal without deformation 
corresponding to the maximum distribution, and the transformed chrominance signal in 
the reference image buffer 112 (step S10). 

[0030] The lack pixel restoration section 116 judges whether it is the chrominance 
signal which reads a reference image from the reference image buffer 112, and has the 
maximum distribution (step Sll), and, in YES, transmits this reference image to the 
output section 117. Moreover, the case of NO compares a reference image with the 
chrominance signal of the rectangle field in each block buffer 106,107,108 for every color 
in the buffer 112 for reference images, it transforms a reference image so that each 
chrominance signal may be suited (step S12), and it is transmitted to the output section 
117. A reference image without deformation and the transformed reference image are 
integrated by this at the output section 117 (step S13). The output section 117 outputs 
the integrated reference image to the exterior as a chrominance signal with which lack 
was restored (step S14). 

[0031] Thus, all lack to (step S15) and the image for one frame is restored by scanning 
and processing each buffers 102 and 103 for signals, and all the images in 104 so that a 
rectangle block may not overlap the above-mentioned processing. 

[0032] Below, how to generate the above-mentioned reference image is explained with 
reference to drawing 6 (a) - (j). With this operation gestalt, a reference image is 
generated using the so-called color edge model. In a partial field, each chrominance 
signal shares the same edge structure between a color edge model. It is checked that 
such a model is materialized in many images which exist in a nature. Therefore, if such 
a model is assumed, the signal of the same configuration will be acquired by adjusting 
the gain (alpha) and bias (beta) of each chrominance signal defined below. 
[0033] Drawing 6 (a), (b), and (c) are drawings showing the gain alphai = 
maximum- minimum value and the bias betai = minimum value (i=r, g, b) with the 
configuration of the subject-copy image in each chrominance signal of R, G, and B, 
respectively. Supposing it is picturized by CCD of the filter arrangement these 
subject-copy images are indicated to be to drawing 6 (d), the chrominance signal 



acquired will serve as distribution as shown in drawing 6 (e), (f), and (g), respectively. 
Then, gain alphai of each chrominance signal of drawing 6 (e), (f), and (g) and bias betai 
Two or more edge structure distribution which is to a base as shown in drawing 6 (h), (0, 
and (j) by adjusting and compounding is acquired. In this case, about the chrominance 
signal which has the maximum distribution as described above, they are gain alphai 
and bias betai. It does not adjust but is gain alphai only about the other chrominance 
signal. Bias betai It adjusts. 

[0034] Next, it is chosen one in two or more edge structure distribution, using a pattern 
with the highest localization as a reference image. For decision of localization, edge 
reinforcement is computed using a predetermined approach, for example, Laplacian, 
and this edge reinforcement chooses the minimum thing. The reference image expresses 
the edge structure compounded without conflict from each chrominance signal, and it is 
thought that the edge structure of a subject-copy image is reflected. Therefore, it is gain 
alphai of each chrominance signal about the gain and bias of this reference image. Bias 
betai The chrominance signal with which lack was recovered can be acquired by 
transforming a least square error as a norm so that it may be made in agreement. 
[0035] They are gain alphai and bias betai analytically so that one reference image may 
not be here chosen after forming much edge structures beforehand, but a performance 
index like Laplacian may be defined in consideration of the effectiveness of selection 
and edge reinforcement may serve as min. It computes. Moreover, gain alphai of all 
chrominance signals Bias betai To ask is not necessarily required and count can be 
simplified by making it double with any one chrominance signal. For example, about the 
chrominance signal with which distribution serves as max, it does not deform so that it 
may mention later, but about the other chrominance signal, it deforms so that the edge 
structure where localization is the highest may be acquired combining the chrominance 
signal with which distribution serves as max. 

[0036] Below, the example which doubles R and B signal with G signal is explained by 
making Laplacian into a performance index. 

[0037] They are alphar and alphab about the gain of R and B signal. It carries out and 
they are betar and betab about bias. It carries out. They are the 1 -dimensional vector fr, 
fg, and fb about the pixel value of R and G which are contained to a partial field, and B 
signal. They are Vector mr, mg, and mb about the mask in which it expresses and the 
lack situation of a pixel is shown. It expresses. A mask shall take the element of 0, when 
a pixel exists and it does not exist 1. Then, the reference image phi is [0038]. 
[Equation 2] 



Cf r' m r' f b ,m b ] 



+ f m = Mv +C 
8 2 



(9) 



It is come out and shown. Here, it is Laplacian delta 2 to the reference image phi. It 
gives, delta 2 phi=| delta2 | (Mv+C) (10) 

It considers minimizing, then, v= talphar, betar, alphab, and betab] - T v=(delta2 M)-l 
(•delta2 C) (ll) 

It is computable to a next door and a meaning. Namely, R to G signal, gain alphar of B 
signal, and alphab Bias betar and betab It can be found. 

[0039] Here, since M does not become a square matrix, it needs to compute the false 
inverse matrix based on a singular value decomposition. Moreover, although (ll) types 
are examples which double R and B signal with G signal, other combination is 
computable similarly. 

[0040] Drawing 7 is drawing showing the process in which a lack pixel is restored based 
on the above-mentioned color edge model. In the following explanation, the rectangle 
field of 5x5 size is used. The subject-copy image shown in drawing 7 (a) responds to 
filter arrangement of CCD203 (input section 101) as been some images of the saddle 
section of a bicycle and shown in drawing 7 (b). Drawing 7 (c), It goes via the buffer 102 
for R signals, the buffer 103 for G signals, the buffer 104 for B signals, and the field 
extract section 105 as a chrominance signal with the lack shown in (d) and (e), 
respectively. It is transmitted to the block buffer 106 for R signals, the block buffer 107 
for G signals, and the block buffer 108 for B signals, respectively. 

[0041] As the chrominance signal with these lack was described above, distribution is 
computed for every chrominance signal by being read by the distributed calculation 
sections 109, 110, and 111. And the signal of others [ base / on the chrominance signal 
with which distribution serves as max in 3 signals of R, G, and B ] is doubled (the 
maximum distribution decision section 150, signal transformation section 151). Here, it 
asks for the gain and bias of R and B signal as that from which distribution of G signal 
-becomes max. Drawing 7 (f) and (h) are gain alphar computed according to the 
above-mentioned (11) types, and alphab. Bias betar and betab R and B signal which 
deformed are shown and (g) shows G signal as it is. 

[0042] The reference image phi as shown in drawing 7 (i) in integrating the image of 



these drawing 7 (f), (g), and (h) is obtained (buffer 112 for reference images). This 
reference image phi is the highest image of localization, if edge reinforcement for which 
it asked by Laplacian is made into a decision criterion. On the other hand, the RGB 
change-over section 113 is beginning to read each block buffers 106 and 107 for signals, 
and a chrominance signal ( drawing 7 (c), (d), (e)) with lack in 108 one by one, computes 
edge reinforcement in the edge on*the-strength calculation section 114, and when this is 
larger than a predetermined threshold, it transmits a chrominance signal with lack to 
the lack pixel restoration section 116. When smaller than a predetermined threshold, it 
is sent to the linear interpolation section 115, and linear interpolation reverts. On the 
other hand, the lack pixel restoration section 116 asks for the gain and bias of the 
above-mentioned reference image phi from the buffer 112 for reference images, and is 
made in agreement with the gain and bias of a chrominance signal with the lack to 
which this was transmitted. With this operation gestalt, since the reference image phi is 
generated according to G signal, about G signal, the gain and bias of the reference 
image phi are in agreement. For this reason, the above-mentioned actuation is 
performed only about R and B signal. The signal acquired by this turns into a signal 
with which lack as shown in drawing 7 (j), (k), and (1) was restored. In integrating these 
in the output section 117, the restored color picture which is shown in drawing 7 (m) is 
obtained. 

[0043] Since a reference image is created by combining evaluation of the localization 
based on a color edge model and Laplacian with all the chrominance signals in the 
partial field judged to be the edge section in the 1st operation gestalt as described above, 
and the lack signal was restored from this reference image, in the conventional linear 
interpolation, the difficult high frequency component can be recovered and a high 
definition restoration image can be obtained by this. Moreover, when not judged as the 
edge section, since it is processed by the usual linear interpolation, it can process at a 
high speed. Moreover, since the frequency of occurrence of RGB3 signal uses equal filter 
arrangement, imbalance a color-difference signal deteriorates as compared with the 
conventional luminance signal does not occur, but a high definition restoration image is 
obtained. 

[0044] In addition, although size of a partial field is set to 5x5 with the above-mentioned 
operation gestalt, it does not need to be limited to this, and a free setup is possible. 
Moreover, although it is processing so that the above-mentioned partial field may not 
overlap, the thing to which the processing time does not become a problem and which it 
will process so that it may overlap at intervals of 1 pixel if it becomes, and is done for 
the averaging of the processing result is also possible. In this case, the error of the color 



edge model by a noise etc. can be reduced. Moreover, although Laplacian is used for 
evaluation of localization, it does not need to be limited to this. For example, the same 
effectiveness can be acquired even if it uses energy, entropy, correlation, or partial 
uniformity computed from a concentration coincidence matrix. Furthermore, filter 
arrangement does not need to be limited to the arrangement shown in drawing 4 , either, 
and a free setup is possible for it. About the filter arrangement which raised the 
frequency of occurrence of a luminance signal as usual, although an improvement effect 
falls a little, it can be processed similarly. 

[0045] Drawing 8 is the functional block diagram of the picture signal processor 
concerning the 2nd operation gestalt of this invention, and explains the connection 
relation of each function below. 

[0046] In drawing 8 , the input section 301 is connected to the buffer 302 for R signals, 
the buffer 303 for G signals, and the buffer 304 for B signals, and each buffers 302, 303, 
and 304 for chrominance signals are connected to the block buffer 306 for R signals, the 
block buffer 307 for G signals, and the block buffer 308 for B signals through the field 
extract section 305, respectively. The block buffer 306 for R signals is connected to the 
mean-dispersion calculation section 309 for R signals, and the RGB change-over section 
317, the block buffer 307 for G signals is connected to the mean-dispersion calculation 
section 310 for G signals, and the RGB change-over section 317, and the block buffer 
308 for B signals is connected to the mean-dispersion calculation section 311 for B 
signals, and the RGB change-over section 317. 

[0047] The mean-dispersion calculation section 309 for R signals, the mean-dispersion 
calculation section 310 for G signals, and the mean-dispersion calculation section 311 
for B signals are connected to the maximum distribution signal selection section 312. 
The maximum distribution signal selection section 312 and the RGB change-over 
section 317 are connected to the buffer 315 for candidate images through the signal 
transformation section 313 and the candidate image generation section 314. The RGB 
change-over section 317 is connected also to the lack pixel restoration section 318 again. 
The buffer 315 for candidate images is connected to the reference image selection 
section 316 and the lack pixel restoration section 318, and the reference image selection 
section 316 is connected to the lack pixel restoration section 318. The lack pixel 
restoration section 318 is connected to the output section 319. 

[0048] Moreover, the control section 320 is connected to the input section 301, the field 
extract section 305, the mean-dispersion calculation section 309 for R signals, the 
mean-dispersion calculation section 310 for G signals, the mean-dispersion calculation 
section 311 for B signals, the maximum distribution signal selection section 312, the 



candidate image generation section 314, the reference image selection section 316, the 
RGB change-over section 317, the lack pixel restoration section 318, and the output 
section 319. 

[0049] In addition, a part of each above-mentioned function consists of hardware, the 
output section 319 is constituted by the magnetic disk and a control section 320 is 
constituted for the input section 301 from this operation gestalt by the 2 plate type CCD 
with a microcomputer. 

[0050] Drawing 9 is drawing showing an example of the concrete configuration of the 
input section 301 shown in drawing 8 . In drawing 9 , a lens system 401, the low pass 
filter 402 for G signals, the objects CCD404 and R for G signals and the low pass filter 
403 for B signals, R, and CCD405 for B signals are arranged possible [ photography of a 
photographic subject ]. CCD404 for G signals is connected to the buffer 303 for G signals 
through A/D converter 406. Moreover, R and CCD405 for B signals are connected to the 
buffer 302 for R signals, and the buffer 304 for B signals through A/D converter 407 and 
the R/B separation circuit 408. It connects with the CCD drive circuit 410 for G signals, 
and R and the CCD drive circuit 411 for B signals, respectively, and, in the CCD drive 
circuit 410 for G signals, and R and the CCD drive circuit 411 for B signals, the objects 
CCD404 and R for G signals and CCD405 for B signals drive respectively the objects 
CCD404 and R for G signals, and CCD405 for B signals based on the clock from a clock 
generator 409. 

[0051] An operation of a configuration of being shown in drawing 8 described above 
below is explained with reference to the flow chart of drawing 10 . 

[0052] First, RGB3 signal for one frame is read through the input section 301 by control 
of a control section 320, and is transmitted to the buffer 302 for R signals, the buffer 303 
for G signals, and the buffer 304 for B signals (step S21). Next, the field extract section 
305 scans an image based on control of a control section 320 (step S22), extracts the 
signal which exists in the rectangle field of the predetermined size centering on a 
certain specific pixel, for example, the field of 15x15 size, (step S23), and transmits it to 
the block buffer 306 for R signals, the block buffer 307 for G signals, and the block 
buffer 308 for B signals, respectively. The mean-dispersion calculation section 309 for R 
signals, the mean-dispersion calculation section 310 for G signals, and the 
mean-dispersion calculation section 311 for B signals compute an average and 
distribution of each chrominance signal based on control of a control section 320 by 
reading the chrominance signal of the rectangle field in each block buffer 306,307,308 
for signals. 

[0053] The maximum distribution signal selection section 312 chooses the average 



computed in each mean-dispersion calculation section 309,310,311 based on control of a 
control section 320, and the chrominance signal which has the greatest distribution 
among 3 chrominance signals among distributions, and transmits it to the signal 
transformation section 313 (step S24). Moreover, based on control of a control section 
320, the RGB change-over section 317 reads the chrominance signal of each block 
buffers 306 and 307 for signals, and the rectangle field in 308 in order, and outputs it to 
the signal transformation section 313. The signal transformation section 313 judges 
whether it is the chrominance signal which gives the maximum distribution about each 
chrominance signal transmitted from the RGB change-over section 317 (step S25), it 
deforms distribution of chrominance signals other than the chrominance signal which 
gives the maximum distribution, and an average so that it may become equal to the 
average of the chrominance signal which gives the maximum distribution, and 
distribution (step S26), and it carries out the sequential transfer of this at the candidate 
image generation section 314. Here, it transmits to the candidate image generation 
section 314 as it is, without deforming about the chrominance signal which gives the 
maximum distribution. 

[0054] The candidate image generation section 314 generates two or more reference 
candidate images by combining the chrominance signal by which the plurality 
transmitted from the signal transformation section 313 was transformed (step S27), and 
transmits these to the buffer 315 for candidate images. After a transfer of all 
combination is completed, based on control of a control section 320, edge reinforcement 
is the smallest, namely, the reference image selection section 316 chooses the reference 
candidate image which was most excellent in localization as a reference image (step 
S28), and sends a selection result to the lack pixel restoration section 318. The lack 
pixel restoration section 318 reads the reference image corresponding to the selection 
result from the reference image selection section 316 from the buffer 315 for candidate 
images. The lack pixel restoration section 318 is based on control of a control section 320 
after termination of this read-out. Each chrominance signal in the block buffer 306 for R 
signals read in order by the RGB change-over section 317, the block buffer 307 for G 
signals, and the block buffer 308 for B signals is received. The reference image read 
from the buffer 315 for candidate images like the above-mentioned 1st operation gestalt 
is transformed so that each chrominance signal may be suited, and it transmits to the 
output section 319 (step S29). The output section 319 integrates this reference image 
that deformed (step S30), and outputs it outside as a chrominance signal with which 
lack of each chrominance signal was restored (step S3l). 

[0055] Thus, all lack to (step S32) and the image for one frame is restored by scanning 



and processing each buffers 302 and 303 for signals, and all the images in 304 so that a 
rectangle block may not overlap the above-mentioned processing. 

[0056] In addition, when the 2 plate type CCD is used like this operation gestalt, it can 
be regarded as that from which the signal which is related with G signals and does not 
have lack is acquired. Therefore, in the field in which G signal fully exists, even if it 
does not use a color edge model, a reference image can be obtained. On the other hand, 
in the field where the saturation of red or blue is high, the level of G signal is low and it 
is easy to be influenced by the noise. In such a case, it is lacking in dependability to 
obtain a reference image from G signal and to restore lack of R and B signal, and it is 
difficult to obtain a highly precise playback image. 

[0057] For this reason, in the mean-dispersion calculation section 309 for R signals, the 
mean-dispersion calculation section 310 for G signals, and the mean-dispersion 
calculation section 311 for B signals, distribution is computed about each of three 
chrominance signals, R, G, and B, and he chooses the chrominance signal which gives 
the greatest distribution in the maximum distribution signal selection section 312, and 
is trying to apply a color edge model based on the chrominance signal which gives this 
greatest distribution with this operation gestalt. In the case of other chrominance 
signals, although the case where the chrominance signal which gives the greatest 
distribution is an R signal is assumed hereafter, it can process similarly. 
[0058] The signal transformation section 313 is G, distributed sigmag of B signal, and 
sigmab. Average AVg and AVb Distributed sigmar of R signal Average AVr Gain alp hag 
for making it in agreement, and alphab Bias betag and betab It computes using the 
following formulas. 



[0059] 

[Equation 3] 




02) 




(13) 



as shown in (12) and (13) types, as for the solution of the gain about one chrominance 
signal, and bias, signs differ - 2 sets is computed at a time and 4 sets of combination 
occurs by G and B signal. At the candidate image generation section 314, they are R 



signal, and above-mentioned gain alphag and alphab. Bias betag and betab Combining 
every 2 sets of G and B signal which deformed, 4 sets of reference candidate images are 
generated, and this is transmitted to the buffer 315 for candidate images. The reference 
image selection section 316 chooses the reference candidate image which whose edge 
reinforcement is the smallest among the above-mentioned reference candidate images, 
namely, was most excellent in localization with Laplacian as a reference image. This 
selection result is transmitted to the lack pixel restoration section 318, and a lack pixel 
is restored by the same approach as the 1st operation gestalt. 

[0060] A small number of reference candidate image is generated by doubling 
distribution and an average of other chrominance signals based on the chrominance 
signal which gives the greatest distribution among the chrominance signals inputted in 
the 2nd operation gestalt, as described above. Since a reference image is chosen from 
evaluation of the localization based on Laplacian and the lack signal was restored, in 
the conventional linear interpolation, the impossible high frequency component can be 
recovered and a high definition restoration image can be obtained by this. Moreover, 
there is little computational complexity for doubling distribution and an average in this 
case, and it can be processed at a high speed. 

[0061] In addition, although the 2 plate type CCD is used with this operation gestalt, it 
is applicable as it is also to the veneer type CCD, for example, the input section using 
filter arrangement of a BEIYA mold. Moreover, although distribution and an average 
are used as a parameter for deformation, it does not need to be limited to this. For 
example, equivalent effectiveness can be acquired even if it uses maximum, the 
minimum value, etc. 

[0062] Drawing 11 is the functional block diagram of the picture signal processor 
concerning the 3rd operation gestalt of this invention, and explains the connection 
relation of each function below. 

[0063] In drawing 11 , the input section 501 is connected to the buffer 502 for R signals, 
the buffer 503 for G signals, and the buffer 504 for B signals, and each buffers 502, 503, 
and 504 for chrominance signals are connected to the block buffer 506 for R signals, the 
block buffer 507 for G signals, and the block buffer 508 for B signals through the field 
extract section 505, respectively. The block buffer 506 for R signals is connected to the 
maximum minimum calculation section 509 for R signals, and the RGB change-over 
.section 513, the block buffer 507 for G signals is connected to the maximum minimum 
calculation section 510 for G signals, and the RGB change-over section 513, and the 
block buffer 508 for B signals is connected to the maximum minimum calculation 
section 511 for B signals, and the RGB change-over section 513. 



[0064] Each maximum minimum calculation sections 509, 510, and 511 for signals are 
connected to the maximum range signal selection section 512. The maximum range 
signal selection section 512 is connected to the processing change-over section 514 and 
the signal transformation section 517. The RGB change-over section 513 is connected to 
the processing change-over section 514. The processing change-over section 514 is 
connected to the linear interpolation section 515, the lack pixel restoration section 516, 
and the signal transformation section 517. The linear interpolation section 515 is 
connected to the output section 523. The signal transformation section 517 is connected 
to the buffer 519 for candidate images through the candidate image generation section 
518. The buffer 519 for candidate images is connected to the reference image selection 
section 520 and the lack pixel restoration section 516, and the reference image selection 
section 520 is connected to the lack pixel restoration section 516. The lack pixel 
restoration section 516 is connected to the luminance -signal generation section 522 and 
the output section 523 through the convergence test section 521. The luminance-signal 
generation section 522 is connected to the lack pixel restoration section 516. 
[0065] Moreover, the control section 524 is connected to the input section 501, the field 
extract section 505, the maximum minimum calculation section 509 for R signals, the 
maximum minimum calculation section 510 for G signals, the maximum minimum 
calculation section 511 for B signals, the maximum range signal selection section 512, 
the RGB change-over section 513, the processing change-over section 514, the lack pixel 
restoration section 516, the candidate image generation section 518, the reference 
image selection section 520, and the output section 523. 

[0066] In addition, a part of each above-mentioned function consists of hardware, the 
output section 523 is constituted by the magnetic disk and a control section 524 is 
constituted for the input section 501 from this operation gestalt by the veneer type CCD 
(refer to drawing 3 ) with a microcomputer. 

[0067] Drawing 12 (a) and (b) are drawings showing the concrete configuration of the 
filter arrangement in the input section 501. As for the frequency of each chrominance 
signal, it is [ the restoration by the color edge model ] desirable for it to be uniform and 
to be arranged at random in order to create a reference image using a total input signal. 
However, if all pixels are arranged at random, it will be necessary to record 
arrangement information and is complicated. 

[0068] For this reason, as the 1st operation gestalt showed, it is possible to repeat the 
configuration of a basic rectangle field and to arrange a filter, the basic rectangle field at 
this time " being related - when the total of the chrominance signal used is made to j 
and k is made into two or more integers, the frequency of occurrence of each 



chrominance signal in jkxjk size and a rectangle field uses the filter arrangement with 
which the frequency of occurrence of each chrominance signal fills constraint of under or 
more 2j in equal and a level perpendicular direction. 

[0069] Although drawing 12 (a) shows an example of basic arrangement of 6x6 size 
about RGB3 signal, randomizing the inside of a rectangle field in false using this 
concentric circular pattern, as shown in drawing 12 (b) is also considered. First, the 
circle of the radius r consisting mainly of the location (dx, dy) of the arbitration of a 
rectangle field, 0 <=dx<=jk, and 0 <=dy<=jk is considered, and the radius r in case the 
locus of this circle intersects an integer coordinate is searched for. This radius r is 
integer-ized and the division of the total of a chrominance signal is done by j. The 
division of the case of RGB3 signal will be done by 3, and remainder becomes three 
kinds, 0, 1, and 2. By applying each chrominance signal to this remainder, if it becomes 
zero, for example, a false random pattern will be obtained by R and assuming that it is 
B signal, if it becomes one and will be G and 2. 

[0070] An operation of a configuration of being shown in drawing 11 described above 
below is explained with reference to the flow chart of drawing 13 . 

[0071] In drawing 13 , RGB3 signal for one frame is read into the radical of control of a 
control section 524 through the input section 501, and is transmitted to the buffer 502 
for R signals, the buffer 503 for G signals, and the buffer 504 for B signals (step S4l). 
Next, the field extract section 505 scans an image based on control of a control section 
524 (step S42). From each chrominance signal for one frame in each buffer 502,503,504 
for chrominance signals The signal which exists in the rectangle field of the 
predetermined size centering on a certain specific pixel, for example, the field of 5x5 size, 
is extracted (step S43), and it transmits to the block buffer 506 for R signals, the block 
buffer 507 for G signals, and the block buffer 508 for B signals, respectively. The 
chrominance signal of the rectangle field in each block buffer 506,507,508 is transmitted 
to the processing change-over section 514 one by one based on the change-over control 
by the RGB change-over section 513. Moreover, it is transmitted to this and coincidence 
at the maximum minimum calculation section 509 for R signals, the maximum 
minimum calculation section 510 for G signals, and the maximum minimum calculation 
section 511 for B signals. A control section 524 controls actuation of the processing 
change-over section 514 until processing in each maximum minimum calculation 
sections 509, 510, and 511 and the maximum range signal selection section 512 is 
completed. The max of each signal and the minimum value are computed in each 
maximum minimum calculation sections 509, 510, and 511 (step S44), and it is 
transmitted to the maximum range signal selection section 512. In the maximum range 



signal selection section 512, it asks for a range from the difference between maximum 
and the minimum value, the signal which has the greatest range in 3 signals is chosen 
(step S45), and it is transmitted to the processing change-over section 514 and the 
signal transformation section 517. 

[0072] In the processing change-over section 514, based on control of a control section 
524, after the processing result in the maximum range signal selection section 512 is 
transmitted, actuation is started. Here, it judges whether the range of the signal which 
has the greatest range of the maximum range signal selection section 512 is larger than 
a predetermined threshold (they are values, such as 32, when a signal is the 10-bit 
precision of 0-1023) (step S46), and the lack pixel restoration section 516 is chosen, in 
NO, in YES, it is judged as a flat field, and it chooses the linear interpolation section 
515. 

[0073] When the linear interpolation section 515 is chosen, well-known linear 
interpolation restores the lack pixel of each chrominance signal, and it outputs to the 
output section 523 (steps S58 and S59). Moreover, when the lack pixel restoration 
section 516 is chosen, based on control of a control section 524, it shifts to processing of 
the signal transformation section 517. In the signal transformation section 517, it 
judges whether it is the signal which gives a maximum range about each chrominance 
signal transmitted from the processing change-over section 514 (step S47), and in NO, 
the range of this signal is transformed so that it may become equal to the range of the 
signal which gives a maximum range (step S48), and it carries out the sequential 
transfer of this at the candidate image generation section 518. In addition, in the case of 
the signal which gives a maximum range, it is transmitted to the candidate image 
generation section 518 as it is, without deforming. 

[0074] In the candidate image generation section 518, the buffer 519 for candidate 
images, and the reference image selection section 520, by the same approach as the 
above-mentioned 2nd operation gestalt, two or more candidate images are generated 
(step S49), a reference image is chosen based on the edge reinforcement, and it 
transmits to the lack pixel restoration section 516 (step S50). The lack pixel restoration 
section 516 restores and integrates the chrominance signal which was missing by 
transforming a reference image so that each chrominance signal may be suited (steps 
S51 and S52). 

[0075] The convergence test section 521 judges whether it is first-time processing (step 
S53), and when it is first-time processing, it transmits the restored chrominance signal 
to the luminance -signal generation section 522 unconditionally. The luminance-signal 
generation section 522 generates a luminance signal Y using the following formulas 



from RGB3 signal. 
[0076] 

Y=0.299R+0.587G+0. 114B (14) 

(14) Since the luminance signal Y acquired by the formula "is compounded from RGB3 
signal, it turns into a signal which dispersion between 3 signals was controlled and was 
localized more. The luminance-signal generation section 522 is transmitted to the lack 
pixel restoration section 516 by using this luminance signal Y as a new reference image 
(step S57). The lack pixel restoration section 516 performs restoration processing for the 
second time, and transmits the result to the convergence test section 521. The 
convergence test section 521 asks for total of the square of the absolute value of the 
difference of the chrominance signal restored last time about processing of the 2nd 
henceforth, and the chrominance signal restored this time, and it repeats the 
above-mentioned processing until this total becomes below a predetermined threshold 
(step S54). Although a threshold changes with sizes of the rectangle field to be used, 
when it converts into per pixel, about ten value is used for it here. When it becomes 
below a threshold, it is judged as that which processing converged, and the restored 
chrominance signal is transmitted to the output section 523 (step S55). 
[0077] Thus, all lack to (step S56) and the image for one frame is restored by scanning 
and processing each buffers 502 and 503 for signals, and all the images in 504 so that a 
rectangle field may not overlap the above-mentioned processing. 

[0078] As described above, the chrominance signal which gives the greatest range in the 
3rd operation gestalt is determined, and it asks for a reference image by doubling the 
maximum minimum value with this chrominance signal, and the chrominance signal 
which was missing from this reference image is restored. Then, in quest of a new 
reference image, restoration processing is again performed from the recovered 
luminance signal, and it repeats until a restoration image converges. Since restoration 
by the reference image localized more is performed by this, a higher definition 
restoration image is obtained. Moreover, since a switch with linear interpolation is 
performed based on the range of a chrominance signal, it can process at a high speed. 
[0079] In addition, it is also possible not to be limited to this, although the chrominance 
signal is chosen using the maximum range called for from the difference between 
maximum and the minimum value with this operation gestalt, and to use valuation 
bases, such as distribution and edge reinforcement. Moreover, other configurations may 
be used, if it does not need to be limited to the arrangement shown in drawing 12 also 
about filter arrangement and random nature is filled. 

[0080] Drawing 14 is the functional block diagram of the image input-process 



equipment concerning the 4th operation gestalt, and explains the connection relation of 
each function below. 

[0081] In drawing 14 , it connects with the buffer 602 for R signals, the buffer 603 for G 
signals, and the buffer 604 for B signals, and the input section 601 is further connected 
to the block buffer 606 for R signals, the block buffer 607 for G signals, and the block 
buffer 608 for B signals through the field extract section 605, respectively. The block 
buffer 607 for G signals is connected to the distributed calculation section 610, the RGB 
change-over section 613, and the signal transformation section 651, and the block buffer 
608 for B signals is connected to the distributed calculation section 609, the RGB 
change-over section 613, and the signal transformation section 651 for the block buffer 
606 for R signals at the RGB change-over section 613. The distributed calculation 
sections 609 and 610 are connected to the signal transformation section 651 through the 
maximum distribution decision section 650. 

[0082] This signal transformation section 651 is connected with the buffer 611 for 
reference images through the data-smoothing section 612 at the lack pixel restoration 
section 614 while connecting with the buffer 611 for reference images through the 
approximation reference image selection section 652 at the lack pixel restoration section 
614. The approximation reference image selection section 652 is connected also to the 
data-smoothing section 612. The RGB change-over section 613 is connected to the 
output section 616 through the lack pixel restoration section 614 and the averaging 
section 615. Moreover, the control section 617 is connected to the input section 601, the 
field extract section 605, the distributed calculation sections 609 and 610, the signal 
transformation section 651, the approximation reference image selection section 652, 
the RGB change-over section 613, the lack pixel restoration section 614, the averaging 
section 615, and the output section 616. 

[0083] Drawing 15 is drawing showing the above-mentioned concrete configuration of 
the signal transformation section 651, and the block buffer 606 for R signals, the block 
buffer 607 for G signals, the maximum distribution decision section 650, selection 
section 651 A that receives the signal from a control section 617, gain bias calculation 
section 65 IB, and operation part 65 1C are connected in order. 

[0084] In addition, a part of each above-mentioned function consists of hardware, the 
output section 616 is constituted by the magnetic disk and a control section 617 is 
constituted for the input section 601 from this operation gestalt by the veneer type CCD 
with a microcomputer. 

[0085] Drawing 16 (a) - drawing 16 (d) are drawings showing the concrete configuration 
of the filter arrangement in the veneer type CCD of this operation gestalt. He considers 



size of 4x2 as shown in drawing 16 (a), and size of 6x3 as shown in drawing 16 (b) as 
basic arrangement, and is trying to be here filled up with all the pixels on CCD by 
repeating and arranging such basic arrangement. Drawing 16 (c) repeats and arranges 
basic arrangement of drawing 16 (a), and drawing 16 (d) "repeats and arranges basic 
arrangement of drawing 16 (b). 

[0086] By basic arrangement of drawing 16 (a), by 3-3:2 and basic arrangement of 
drawing 16 (b), the frequency of occurrence of RGB3 signal is set up so that it may be set 
to 4:4:1. These frequencies of occurrence can be changed according to the amount of 
aberration of a lens system. That is, if the amount of aberration of a lens system 
increases, since a high frequency component deteriorates, it may reduce the frequency 
of occurrence of a corresponding chrominance signal. The frequency of occurrence of a 
chrominance signal can be adjusted according to the threshold value of the high 
frequency component computed from the amount of aberration. 

[0087] An operation of a configuration of being shown in drawing 14 described above 
below is explained with reference to the flow chart of drawing 17 . 

[0088] In the following explanation, to R and G signal, the lens system used in the input 
section 601 has minute aberration, and assumes that aberration is large to B signal. 
Moreover, the amount of aberration of a lens system shall be measured beforehand. 
RGB3 signal for one frame is read through the input section 601 based on control of a 
control section 617, and is transmitted to the buffer 602 for R signals, the buffer 603 for 
G signals, and the buffer 604 for B signals (step S61). The field extract section 605 scans 
an image based on control of a control section 617 (step S62). From each chrominance 
signal for one frame in each buffer 602,603,604 for signals The signal which exists in the 
rectangle field of the predetermined size centering on a certain specific pixel, for 
example, the field of 7x7 size, is extracted (step S63), and it transmits to the block buffer 
606 for R signals, the block buffer 607 for G signals, and the block buffer 608 for B 
signals, respectively. 

[0089] Based on control of a control section 617, the RGB change-over section 613 is 
beginning to read the chrominance signal of each block buffers 606 and 607 and the 
rectangle field in 608 one by one, and transmits it to the lack pixel restoration section 
614. The lack pixel restoration section 614 judges whether the amount of chromatic 
aberration of the inputted chrominance signal is large (step S64), and when large, it 
shifts to step S72. Here, when the aberration over a lens system is large B signal, it 
shifts to step S72. On the other hand, when the aberration over a lens system is small R 
and G signal, it shifts to step S65. 

[0090] Processing shifts to the distributed calculation sections 609 and 610 through a 



control section 617 here. Namely, the distributed calculation sections 609 and 610 
compute distribution of each chrominance signal based on control of a control section 
617 by reading each chrominance signal in each block buffer 606 and 607, respectively. 
Next, the maximum distribution decision section 650 determines the chrominance 
signal which has the greatest distribution among each computed distribution (step S65). 
[0091] Selection section 65 1A ( drawing 15 ) of the signal transformation section 651 
chooses one side of each chrominance signal of each block buffer 606 and the rectangle 
field in 607 based on control of a control section 617 by whether it is the signal with 
which the chrominance signal from the maximum distribution decision section 650 has 
the maximum distribution (step S66). The chrominance signal corresponding to the 
maximum distribution is outputted to the buffer 611 for reference images among each 
chrominance signal of each block buffer 606 and the rectangle field in 607, without 
deforming. About what is not the chrominance signal of the maximum distribution, it is 
outputted to gain bias calculation section 65 IB. Gain bias calculation section 65 IB is 
gain alphai about the inputted chrominance signal. Bias betai It computes (step S67) 
and outputs to operation part 65 1C with the chrominance signal concerned. Operation 
part 65 1C is computed gain alphai. Bias betai It uses, the chrominance signal concerned 
is transformed and it outputs to the reference image buffer 611 (step S68). Two or more 
approximation reference images are generated by integrating the chrominance signal 
without deformation corresponding to the maximum distribution, and the transformed 
chrominance signal in the buffer 611 for reference images (step S69). 
[0092] Two or more generated approximation reference images are transmitted to the 
data-smoothing section 612 and the approximation reference image selection section 
652. The approximation reference image selection section 652 chooses an approximation 
reference image based on edge reinforcement like the 1st operation gestalt (step S70), 
and transmits it to the data-smoothing section 612 and the lack pixel restoration section 
614. The data* smoothing section 612 graduates an approximation reference image 
according to the amount of aberration of the lens system about B signal, generates a 
smoothing approximation reference image, and transmits it to the lack pixel restoration 
section 614 (step S7l). 

[0093] The lack pixel restoration section 614 transforms B signal based on a smoothing 
approximation reference image among the chrominance signals of R, G, and B which 
were read through the RGB change-over section 613 (step S72). And this chrominance 
signal that deformed, and an approximation reference image are integrated, a reference 
image is obtained (step S73), the chrominance signal which is missing based on this 
reference image is restored, and it transmits to the averaging section 615 (step S74). 



[0094] Thus, all lack to (step S75) and the image for one frame is restored by scanning 
and processing each buffers 602 and 603 for signals, and all the images in 604 so that a 
rectangle block may not overlap the above-mentioned processing. The restored 
chrominance signal is transmitted to the averaging section 615. If a rectangle field is 
7x7 size, 49 restored chrominance signals will be transmitted to this averaging section 
615 about one pixel. The averaging section 615 carries out averaging of these 
chrominance signals (step S76), and outputs them to the output section 616. 
[0095] Drawing 18 (a) - drawing 18 (o) are drawings for explaining how restoring a lack 
pixel using a color edge model to the bottom of existence of chromatic aberration. The 
following explains the case of a single dimension. Drawing 18 (a), (b), and (c) show the 
configuration of the subject-copy image in RGB3 signal, respectively. Drawing 18 (d), (e), 
and (f) show the degradation condition of RGB3 signal when being picturized by the lens 
system with chromatic aberration, respectively. Here, it assumes that there is chromatic 
aberration only in B signal as shown in drawing. Supposing these chrominance signals 
are picturized with the veneer CCD of the filter arrangement shown in drawing 18 (g), 
the chrominance signal acquired is shown in drawing 18 (h), (0, and (j), respectively. 
[0096] Here, like the 1st operation gestalt, if the gain and bias of R signal of drawing 18 
(h) and G signal of drawing 18 (i) are adjusted, respectively, two or more reference 
images which have the fundamental edge structure shown in drawing 18 (k) and 
drawing 18 (1) will be obtained. What is necessary is just to choose what was most 
excellent in localization out of two or more of these reference images, i.e., the small 
reference image of edge reinforcement. However, the pixel corresponding to B signal is 
missing, and the reference image obtained by doing in this way differs from a perfect 
reference image. Therefore, this is called an approximation reference image. 
[0097] Next, the smoothing approximation reference image shown in drawing 18 (m) is 
obtained by graduating this approximation reference image corresponding to the 
amount of chromatic aberration. B signal of drawing 18 (j) is transformed by adjusting 
the gain and bias of B signal based on this smoothing approximation reference image 
( drawing 18 (n)). And a final reference image as shown in drawing 18 (o) is obtained by 
compounding the approximation reference image of drawing 18 (1) with more small edge 
reinforcement, and B signal by which drawing 18 (n) was transformed. Future 
restoration processings are the same as that of the 1st operation gestalt. 
[0098] In the above-mentioned 4th operation gestalt, an approximation reference image 
is first obtained using a signal with little chromatic aberration. And adaptation with a 
signal with much chromatic aberration is performed by graduating this reference image, 
and he obtains a perfect reference image, and is trying to restore a lack signal from this 



reference image. Therefore, even when a cheap lens system is used, a high definition 
restoration image can be generated. Moreover, since the frequency of occurrence of 
RGB3 signal is adjusted according to chromatic aberration, an efficient image pick-up is 
attained. 

[0099] In addition, although it assumed that chromatic aberration existed in B signal 
with this operation gestalt, it does not need to be limited to this and can process 
similarly to the signal of arbitration. 

A. Invention of the following configurations is extracted from the above-mentioned 
concrete operation gestalt. 

(1) In the picture signal processor which processes the picture signal with which the 
picture signal which one pixel has consists of two or more chrominance signals, and 
with which at least one or more chrominance signals are missing according to the 
location of a pixel An extract means to extract the chrominance signal of the partial field 
of the predetermined size which includes the specified pixel from the above-mentioned 
picture signal, A reference image generation means to generate a reference image by 
transforming and compounding each chrominance signal in the partial field extracted 
with this extract means based on a predetermined structure model and a predetermined 
performance index, The picture signal processor characterized by providing a 
restoration means to restore a missing chrominance signal, based on the reference 
image generated with this reference image generation means. 

(2) The above-mentioned reference image generation means is a picture signal processor 
given in the configuration (l) two or more chrominance signals of whose are 
characterized by using the color edge model which shares the same edge pattern as the 
above-mentioned structure model. 

(3) In the picture signal processor which processes the picture signal with which the 
picture signal which one pixel has consists of two or more chrominance signals, and 
with which at least one or more chrominance signals are missing according to the 
location of a pixel An extract means to extract the chrominance signal of the partial field 
of the predetermined size which includes the specified pixel from the above-mentioned 
picture signal, A chrominance -signal selection means to compute a predetermined 
parameter for every chrominance signal in the partial field extracted with this extract 
means, and to choose one chrominance signal based on this parameter, The deformation 
means which transforms a chrominance signal so that it may become the same as that 
of the parameter of the chrominance signal with which the above-mentioned parameter 
was chosen about chrominance signals other than the chrominance signal chosen with 
this chrominance-signal selection means, A candidate image generation means to 



compound two or more chrominance signals of each which deformed with this 
deformation means, and the chrominance signal chosen by the above-mentioned 
chrominance-signal selection means, and to generate two or more reference candidate 
images, A reference image selection means to choose one reference image from two or 
more reference candidate images generated with this candidate image generation 
means based on a predetermined performance index, The picture signal processor 
characterized by providing a restoration means to restore a missing chrominance signal, 
based on the reference image chosen with the above-mentioned reference image 
selection means. 

(4) The above-mentioned chrominance-signal selection means and the above-mentioned 
deformation means are a picture signal processor given in the configuration (3) 
characterized by using an average and distribution or the maximum, and the minimum 
value of each chrominance signal as a parameter. 

(5) -1 above reference image generation means is a picture signal processor the 
configuration (l) characterized by using the edge reinforcement obtained by giving 
Laplacian to each chrominance signal as the above-mentioned performance index, the 
energy computed from the concentration coincidence matrix of each chrominance signal, 
entropy, correlation, partial uniformity, or inertia, or given in (2). 

(5) -2 above reference image selection means is a picture signal processor given in the 
configuration (3) characterized by using the edge reinforcement obtained by giving 
Laplacian to each chrominance signal as the above-mentioned performance index, the 
energy computed from the concentration coincidence matrix of each chrominance signal, 
entropy, correlation, partial uniformity, or inertia. 

(6) -1 -* a picture signal processor given in a configuration (3) equipped with a selection 
means to choose whether the above-mentioned chrominance-signal selection means 
given in a configuration (3) and the processing means after it are made to process by 
judging the chrominance signal which is the output of said extract means by the 
predetermined valuation basis, or a linear interpolation restoration means is made to 
process. 

(6) -2 a picture signal processor a configuration (1) equipped with a selection means to 
choose whether the above-mentioned reference image generation means given in a 
configuration (l) and the processing means after it are made to process by judging the 
chrominance signal which is the output of said extract means by the predetermined 
valuation basis, or a linear interpolation restoration means is made to process, or given 
in (2). 

(6) -11 -- a picture signal processor given in configuration (6)-l performed by the 



decision by said predetermined valuation basis computing either the edge 
reinforcement of the chrominance signal which is the output of said extract means, 
distribution or the maximum minimum value, and comparing the calculation value with 
a predetermined threshold. 

(6) -12 - a picture signal processor given in configuration (6)-2 performed by the 
decision by said predetermined valuation basis computing either the edge 
reinforcement of the chrominance signal which is the output of said extract means, 
distribution or the maximum minimum value, and comparing the calculation value with 
a predetermined threshold. 

(7) Provide further an input means to have image pick-up equipment which acquires 
two or more above-mentioned chrominance signals by picturizing a photographic 
subject. Each pixel of said image pick-up equipment has a color filter corresponding to 
one chrominance signal, said " a color filter - spatial arrangement - m n " three - 
more than " an integer - ** carrying out - mxn - size - a rectangle - a field - 
iteration - constituting - having - the above a rectangle a field - inside - each - a 
chrominance signal ■■ the frequency of occurrence - equal - becoming - as setting up 
■- having - **** - things - the description " ** - carrying out " a configuration (-- 
one --) - (" three --) - a publication - an image -- input process " equipment . 

(8) Provide further an input means to have image pick-up equipment which acquires 
two or more above-mentioned chrominance signals by picturizing a photographic 
subject. Each pixel of said image pick-up equipment has a color filter corresponding to 
one chrominance signal. The spatial arrangement of said color filter When the total of 
the chrominance signal used is made to j and k is made into two or more integers, it is 
constituted repeatedly [ of the rectangle field of jkxjk size ]. the above - a rectangle - a 
field " inside -- each - a chrominance signal - the frequency of occurrence - equal — 
and -- level a perpendicular direction setting ■■ each - a chrominance signal the 
frequency of occurrence - two - more than - j the following becoming " as ~ setting 
up -- having - **** - things - the description - ** - carrying out " a configuration (-- 
one --) - (*- three ") *• a publication an image -- input process " equipment . 

(9) Provide further an input means to have image pick-up equipment which acquires 
two or more above-mentioned chrominance signals by picturizing a photographic 
subject. Each pixel of said image pick-up equipment has a color filter corresponding to 
one chrominance signal. The spatial arrangement of said color filter When the total of 
the chrominance signal used is made to j and k is made into two or more integers, it is 
constituted repeatedly [ of the rectangle field of jkxjk size ]. the above ■- a rectangle - a 
field -- inside - each - a chrominance signal the frequency of occurrence -- equal - 



and - the ~ arrangement - a rectangle - a field - inside ~ one - a point - a core - ** - 
carrying out - a concentric circle - a locus - an integer - a coordinate - crossing - the 
time ■■ a radius j - a division " having carried out - the time - a remainder - being 
based - setting up - having - **** - things the description - ** carrying out - a 
configuration - (-- one --) - (-- three --) - a publication " an image - input process " 
equipment . 

(10) The above-mentioned restoration means is a picture signal processor given in 
configuration (l) - (3) characterized by including a luminance -signal generation means 
to generate a luminance signal from each chrominance signal restored based on the 
above-mentioned reference image, and a convergence decision means to make the 
restoration processing using the above-mentioned luminance signal repeat based on 
distribution of the above-mentioned luminance signal. 

(11) In the image input-process equipment which carries out input process of the picture 
signal with which the picture signal which one pixel has consists of two or more 
chrominance signals, and with which at least one or more chrominance signals are 
missing according to the location of a pixel The input means which consists of an optical 
lens system which produces chromatic aberration, and image pick-up equipment with 
which the frequency of occurrence of a chrominance signal was adjusted based on this 
amount of chromatic aberration, In each chrominance signal in the partial field 
extracted with an extract means to extract the chrominance signal of the partial field of 
the predetermined size which includes the specified pixel from the picture signal 
acquired from this input means, and this extract means An approximation reference 
image generation means to generate an approximation reference image by transforming 
and compounding a chrominance signal with few amounts of chromatic aberration 
based on a predetermined structure model and a predetermined performance index, A 
smoothing means to graduate the approximation reference image generated with this 
approximation reference image generation means based on the amount of chromatic 
aberration of a chrominance signal with many amounts of chromatic aberration, The 
picture input device which generates a reference image based on the approximation 
reference image generated with the above-mentioned approximation reference image 
generation means, and the approximation reference image graduated with the 
above-mentioned smoothing means, and is characterized by providing a restoration 
means to restore a missing chrominance signal. 

(12) The above-mentioned approximation reference image generation means is image 
input-process equipment given in the configuration (ll) two or more chrominance 
signals of whose are characterized by using the color edge model which shares the same 



edge pattern as the above-mentioned structure model. 

(13) The above-mentioned approximation reference image generation means is image 
input-process equipment given in the configuration (ll) characterized by using the edge 
reinforcement obtained by giving Laplacian to each chrominance signal as the 
above-mentioned performance index, the energy computed from the concentration 
coincidence matrix of each chrominance signal, entropy, correlation, partial uniformity, 
or inertia. 

B. The above-mentioned configuration (l) "Object of the Invention" about - (13) is as 
follows. 

Configuration (l)(2)(5)-l and 2 conventional techniques are linear interpolation about a 
luminance signal, are compensated with the color-difference signal based on linear 
interpolation or a luminance signal, and cannot respond about the point of restoring a 
missing chrominance signal with high precision. This invention aims at offering the 
picture signal processor which can restore the chrominance signal which is missing 
based on the structure model of an image with high precision paying attention to this 
point. 

configuration (3), (4), and (5)- 1, 2, (6)-l, 2 and 11, and 12 conventional techniques are 
linear interpolation about a luminance signal, are compensated with the 
color-difference signal based on linear interpolation or a luminance signal, and cannot 
respond about the point of restoring a missing chrominance signal with high precision. 
This invention aims the chrominance signal which is missing based on the structure 
model of an image at highly precise and offering the picture signal processor which can 
be restored to a high speed paying attention to this point. 
A configuration (7), (8) (9), 

The conventional technique is compensated with the color-difference signal based on the 
luminance signal, needs to make [ more ] the number of filters which is equivalent to a 
luminance signal beforehand than the number of filters corresponding to a 
color-difference signal, and cannot respond to filter arrangement of an equal ratio. This 
invention aims at offering the picture signal processor which can restore the 
chrominance signal which is missing when the ratio of each chrominance signal is equal 
with high precision paying attention to this point. 
Configuration (10) 

The conventional technique is linear interpolation about a luminance signal, and is 
compensated with the color-difference signal based on linear interpolation or a 
luminance signal, and cannot respond about the point of restoring a missing 
chrominance signal with high precision. This invention aims at offering the picture 



signal processor which can restore the chrominance signal which is missing based on 
using the structure model of an image repetitively with high precision paying attention 
to this point. 

A configuration (ll), (12) (13), 

The conventional technique is linear interpolation about a luminance signal, and is 
compensated with the color-difference signal based on linear interpolation or a 
luminance signal, and cannot respond to the cheap optical lens system which chromatic 
aberration in which a specific signal deteriorates produces. This invention aims at 
offering the image input-process equipment which can restore the chrominance signal 
which is missing also about the signal acquired by graduating the structure model of an 
image based on chromatic aberration using the cheap optical lens system with high 
precision paying attention to this point. 

C. The above-mentioned configuration (l) "The gestalt of implementation of 
corresponding invention" about - (13), "an operation", and the "effectiveness" are as 
follows. 

configuration (l), (2), and (5)- 1, 2, (6)-l, and 2, 11 and 12 (7), 

"the gestalt of implementation of corresponding invention" - the 1st operation gestalt 
described above at least corresponds to this invention. It is set up so that it may be 
constituted repeatedly [ of the rectangle field of mxn size where the spatial arrangement 
of a color filter / in / including CCD203 of drawing 3 / in the input means under 
configuration / this CCD203 / makes m and n three or more integers ] and the frequency 
of occurrence of each chrominance signal may become equal in the above-mentioned 
rectangle field. The extract means under configuration contains the field extract section 
105 shown in drawing 1 . The reference image generation means under configuration 
contains the distributed calculation sections 109, 110, and 111 of drawing 1 , the 
maximum distribution decision section 150, the signal transformation section 151, and 
the buffer 112 for reference images. As a structure model, two or more chrominance 
signals use the color edge model which shares the same edge pattern, for example. 
Moreover, the edge reinforcement obtained by giving Laplacian for example, to each 
chrominance signal as a performance index, the energy computed from the 
concentration coincidence matrix of each chrominance signal, entropy, correlation, 
partial uniformity, or inertia is used. The restoration means under configuration 
-contains the edge on*the- strength calculation section 114 of drawing 1 which is a 
selection means and the linear interpolation section 115, and the lack pixel restoration 
section 116. The edge on-the-strength calculation section 114 switches the linear 
interpolation section 115 and the lack pixel restoration section 116 based on valuation 



bases, such as for example, edge reinforcement, distribution, or a minimax value. 
[0100] The desirable example of application of this invention is as follows. The picture 
signal from the input section 101 shown in drawing 1 , drawing 3 , and drawing 4 is 
saved with the buffer 102 for R signals, the buffer 103 for G signals, and the buffer 104 
for B signals, the chrominance signal of the field of predetermined size is extracted in 
the field extract section 105, and it transmits to the block buffer 106 for R signals, the 
block buffer 107 for G signals, and the block buffer 108 for B signals. The edge 
on-the-strength calculation section 114 chooses the linear interpolation section 115 or 
the lack pixel restoration section 116 based on the edge reinforcement of all the 
chrominance signals in the block buffer 106 for R signals, the block buffer 107 for G 
signals, and the block buffer 108 for B signals. When the linear interpolation section 115 
is chosen, well-known linear interpolation restores a lack pixel, and it transmits to the 
output section 117. When the lack pixel restoration section 116 is chosen, the signal 
transformation section 151 transforms each chrominance signal using the color edge 
model shown in drawing 6 based on the information about the maximum distribution 
from the maximum distribution decision section 150. A reference image is generated in 
these chrominance signals being integrated by the buffer 112 for reference images. As 
shown in drawing 7 , the lack pixel restoration section 116 restores a lack pixel based on 
a reference image, and transmits it to the output section 17. 

Based on the edge reinforcement of "operation" each chrominance signal, restoration by 
the usual linear interpolation and restoration by the structure model are switched, 
when restoration by the structure model is chosen, a reference image is generated from 
a color edge model, and the information on a lack pixel is restored from this reference 
image. 

The restoration by "effectiveness" structure model becomes possible [ restoring a lack 
pixel in a precision equivalent to the precision at the time of picturizing using the image 
pick-up equipment of a 3 plate type ] in order to generate a reference image using all the 
signals of about 5x5 to 15x15 large field. Moreover, compute edge reinforcement, it is 
made to perform the usual linear interpolation about a part for a flat part, and 
improvement in the speed of processing also becomes possible. 

configuration (3), (4), and (5)- 1 and 2 "the gestalt of implementation of corresponding 
invention" - this invention corresponds to the 2nd operation gestalt described above at 
least. The extract means under configuration contains the field extract section 305 
shown in drawing 8 . The signal selection means under configuration contains the 
mean-dispersion calculation section 309 for R signals of drawing 8 , the mean-dispersion 
calculation section 310 for G signals, the mean-dispersion calculation section 311 for B 



signals, and the maximum distribution signal selection section 312. The deformation 
means under configuration contains the signal transformation section 313 of drawing 8 . 
Although extract and deformation are performed with an extract means and a 
deformation means based on an average and distribution of each chrominance signal, it 
is also possible to perform extract and deformation based on max and the minimum 
value. The candidate image generation means under configuration contains the 
candidate image generation section 314 of drawing 8 . The reference image selection 
means under configuration contains the reference image selection section 316 of 
drawing 8 . The edge reinforcement obtained by giving Laplacian for example, to each 
chrominance signal as a performance index, the energy computed from the 
concentration coincidence matrix of each chrominance signal, entropy, correlation, 
partial uniformity, or inertia is used. The restoration means under configuration 
contains the lack pixel restoration section 318 of drawing 8 . 

[0101] The desirable example of application of this invention is as follows. The picture 
signal from the input section 301 shown in drawing 8 and drawing 9 is saved with the 
buffer 302 for R signals, the buffer 303 for G signals, and the buffer 304 for B signals, 
the chrominance signal of the field of predetermined size is extracted in the field extract 
section 305, and it transmits to the block buffer 306 for R signals, the block buffer 307 
for G signals, and the block buffer 308 for B signals. The mean-dispersion calculation 
section 309 for R signals, the mean-dispersion calculation section 310 for G signals, and 
the mean-dispersion calculation section 311 for B signals compute the average and 
distribution by reading each chrominance signal in each block buffers 306 and 307 for 
signals, and 308. The maximum distribution signal selection section 312 chooses the 
chrominance signal which gives the greatest distribution, and the signal transformation 
section 313 deforms it for other chrominance signals so that it may be in agreement 
with the average and distribution of a chrominance signal which give this greatest 
distribution. The candidate image generation section 314 generates two or more 
candidate images by combining the chrominance signal which gives the greatest 
distribution, and the chrominance signal which deformed. The reference image selection 
section 316 chooses one reference image from two or more of these candidate images 
based on edge reinforcement, and the lack pixel restoration section 318 restores a lack 
pixel based on the selected reference image, and it transmits it to the output section 319. 
After choosing the signal which gives the maximum distribution from each chrominance 
signal by which a "operation" input is carried out and transforming other chrominance 
signals according to this chrominance signal, two or more candidates of a reference 
image are generated combining these chrominance signals. A reference image is chosen 



from these candidates based on edge reinforcement, and the information on a lack pixel 
is restored from this reference image. 

Since computational complexity can be lessened by choosing it as the signal which gives 
the "effectiveness" maximum distribution based on doubling other chrominance signals 
and edge reinforcement, a reference image is generable at a high speed. Since this 
reference image is generated using all the signals of about 5x5 to 15x15 large field, it 
becomes possible [ restoring a lack pixel in the precision which is equal to a 3 plate 
type ]. 

configuration (3), (4), and (5)- (l, 2, (6)-l, 2, 11 and 12, 8), and (9) (10), 
"the gestalt of implementation of corresponding invention" -■ this invention corresponds 
to the 3rd operation gestalt described above at least. When the spatial arrangement of 
the color filter in this CCD makes to j the total of the chrominance signal used including 
CCD, for example and k is made into two or more integers, the input means under 
configuration is constituted repeatedly [ of the rectangle field of jkxjk size ], its 
frequency of occurrence of each chrominance signal in the above-mentioned rectangle 
field is equal, and it is set up so that the frequency of occurrence of each chrominance 
signal may become under or more 2j in a level perpendicular direction. Or when the 
total of the chrominance signal used is made to j and k is made into two or more integers, 
it is constituted repeatedly [ of the rectangle field of jkxjk size ], and the frequency of 
occurrence of each chrominance signal in the above-mentioned rectangle field is equal, 
and it is set up based on the remainder when doing the division of the radius in case the 
locus of the concentric circle [ arrangement / the ] centering on one in a rectangle field 
crosses an integer coordinate by j. The extract means under configuration contains the 
field extract section 505 shown in drawing 11 . The signal selection means under 
configuration contains the maximum minimum calculation section 509 for R signals of 
drawing 11 , the maximum minimum calculation section 510 for G signals, the 
maximum minimum calculation section 511 for B signals, and the maximum range 
signal selection section 512. The deformation means under configuration contains the 
signal transformation section 517 of drawing 11 . Although an extract means and a 
deformation means perform extract and deformation based on the maximum and the 
minimum value of each chrominance signal, they can also perform extract and 
deformation based on an average and distribution. The candidate image generation 
means under configuration contains the candidate image generation section 518 of 
drawing 11 . The reference image selection means under configuration contains the 
reference image selection section 520 of drawing 11 . The energy, the entropy, the 
correlation, partial uniformity, or inertia computed from the edge reinforcement 



obtained by giving Laplacian for example, to each chrominance signal as a performance 
index or the concentration coincidence matrix of each chrominance signal is used. The 
restoration means under configuration contains the processing change-over section 514 
of drawing 11 which is a selection means and the linear interpolation section 515, the 
lack pixel restoration section 516, the convergence test section 521, and the 
luminance -signal generation section 522. The processing change-over section 514 
switches the linear interpolation section 515 and the lack pixel restoration section 516 
based on valuation bases, such as for example, edge reinforcement, distribution, or a 
minimax value. The luminance -signal generation section 522 generates a luminance 
signal from each chrominance signal restored based on the reference image, and the 
convergence test section 521 makes the restoration processing using the 
above-mentioned luminance signal repeat based on distribution of the above-mentioned 
luminance signal. 

[0102] The desirable example of application of this invention is as follows. The picture 
signal from the input section 501 shown in drawing 11 is saved with the buffer 502 for R 
signals, the buffer 503 for G signals, and the buffer 504 for B signals. The field extract 
section 505 extracts the chrominance signal of the field of predetermined size, and 
outputs it to the maximum minimum calculation section 509 for R signals, the 
maximum minimum calculation section 510 for G signals, and the maximum minimum 
calculation section 511 for B signals through the block buffer 506 for R signals, the block 
buffer 507 for G signals, and the block buffer 508 for B signals. The max of each 
chrominance signal and the minimum value are computed here, the chrominance signal 
which gives the greatest range (= maximum -minimum value) in the maximum range 
signal selection section 512 is chosen, and it is transmitted to the processing 
change over section 514. When the linear interpolation section 515 or the lack pixel 
restoration section 516 is chosen based on a maximum range in the processing 
change-over section 514 and the linear interpolation section 515 is chosen, a lack pixel 
is restored by well-known linear interpolation, and it is transmitted to the output 
section 523. Other chrominance signals are transformed so that it may be in agreement 
with the max of a chrominance signal and the minimum value which give the greatest 
range in the signal transformation section 517, when the lack pixel restoration section 
516 is chosen. By combining the chrominance signal which gives the greatest range in 
the candidate image generation section 518, and the chrominance signal which 
deformed, two or more candidate images are generated and one reference image is 
chosen from two or more candidate images based on edge reinforcement in the reference 
image selection section 520. The lack pixel restoration section 516 restores a lack pixel 



based on this reference image, and transmits it to the convergence test section 521. In 
first-time processing, unconditionally, the convergence test section 521 transmits the 
chrominance signal restored until total of the square of the absolute value of a 
difference with the image restored last time became below - a predetermined threshold 
2nd henceforth to the luminance -signal generation section 522. The luminance -signal 
generation section 522 compounds a luminance signal from the restored chrominance 
signal, and the lack pixel restoration section 516 performs restoration processing again 
based on the above-mentioned luminance signal. And the image restored when total of 
the square of the absolute value of a difference with the image with which last time was 
restored in the convergence test section 521 became below a predetermined threshold is 
transmitted to the output section 523. 

(Operation) After choosing the signal which gives a maximum range from each 
chrominance signal inputted and transforming other chrominance signals according to 
this chrominance signal, two or more candidates of a reference image are generated 
combining these chrominance signals. A reference image is chosen from the candidate of 
these plurality based on edge reinforcement, and the information on a lack pixel is 
restored from this reference image. Furthermore, a luminance signal is generated from 
the restored image and restoration processing is again performed using this, and it 
repeats until change becomes below a predetermined threshold to the image restored 
last time. 

(Effectiveness) Since computational complexity can be lessened by choosing it as the 
signal which gives a maximum range based on doubling other chrominance signals and 
edge reinforcement, a reference image is generable at a high speed. Since this reference 
image is generated using all the signals of about 5x5 to 15x15 large field, it becomes 
possible [ restoring a lack pixel in the precision which is equal to a 3 plate type ]. 
Furthermore, since restoration processing is repetitively performed using a luminance 
signal, restoration of a highly precise lack pixel is attained. 
A configuration (11), (12) (13), 

"the gestalt of implementation of corresponding invention" - this invention corresponds 
to the 4th operation gestalt described above at least. The input means under 
configuration contains the input section 601 of drawing 14 . The extract means under 
configuration contains the field extract section 605 shown in drawing 14 . The 
approximation reference image generation means under configuration contains the 
distributed calculation sections 609 and 610 of drawing 14 , the maximum distribution 
decision section 650, the signal transformation section 651, and the buffer 611 for 
reference images. As a structure model, two or more chrominance signals use the color 



edge model which shares the same edge pattern. Moreover, the edge reinforcement 
obtained by giving Laplacian for example, to each chrominance signal as a performance 
index, the energy computed from the concentration coincidence matrix of each 
chrominance signal, entropy, correlation, partial uniformity, or inertia is used. The 
smoothing means under configuration contains the data-smoothing section 612 of 
drawing 14 . The restoration means under configuration contains the lack pixel 
restoration section 614 of drawing 14 , and the averaging section 615. 
[0103] The desirable example of application of this invention is as follows. The picture 
signal from the input section 601 shown in drawing 14 and drawing 16 is saved with the 
buffer 602 for R signals, the buffer 603 for G signals, and the buffer 604 for B signals. 
The field extract section 605 extracts the chrominance signal of the field of 
predetermined size, and transmits it to the block buffer 606 for R signals, the block 
buffer 607 for G signals, and the block buffer 608 for B signals. The distributed 
calculation section 609 and the distributed calculation section 610 compute distribution 
of the chrominance signal of R and G respectively, and determine a chrominance signal 
with the distribution greatest in the maximum distribution decision section 650. The 
signal transformation section 651 transforms chrominance signals other than the 
chrominance signal corresponding to the greatest distribution based on the gain and 
bias of a chrominance signal with the greatest distribution. An approximation reference 
image is generated in these chrominance signals being integrated in the buffer 611 for 
reference images. The data-smoothing section 612 graduates this approximation 
reference image based on the amount of chromatic aberration. The lack pixel 
restoration section 614 generates a reference image based on an approximation 
reference image and the graduated approximation reference image, and restores a lack 
pixel based on this reference image. The averaging section 615 carries out averaging of 
the chrominance signal restored for every field, and transmits it to the output section 
616. 

Choose a chrominance signal with few amounts of chromatic aberration from the input 
signals acquired from the image pick-up equipment with which the frequency of 
occurrence of a chrominance signal was adjusted according to the amount of chromatic 
aberration, and an approximation reference image is generated with the application of a 
structure model. (Operation) On the other hand, this approximation reference image is 
graduated according to the amount of chromatic aberration of a chrominance signal 
with many amounts of chromatic aberration. Based on the graduated near reference 
image, a chrominance signal with many amounts of chromatic aberration is 
transformed, it asks for a reference image by compounding the above-mentioned 



approximation reference image and an image with many amounts of chromatic 
aberration which deformed, and the information on a lack pixel is restored from this 
reference image. 

(Effectiveness) A structure model is first applied to a chrominance signal with few 
amounts of chromatic aberration directly, and a structure model is applied to a 
chrominance signal with many amounts of chromatic aberration by graduating. For this 
reason, finally a reference image will be generated using all chrominance signals, and 
restoration of a highly precise lack color is attained. Moreover, since a lack color can be 
restored even if it uses a cheap lens system with chromatic aberration, the cost of the 
whole equipment can be reduced. 
[0104] 

[Effect of the Invention] According to invention according to claim 1, a missing 
chrominance signal can be restored now with high precision. 

[0105] Moreover, according to invention according to claim 2, the chrominance signal 
which is missing even when a cheap optical lens system is used can be restored now 
with high precision. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing ll It is the functional block diagram of the picture signal processor concerning 
the 1st operation gestalt of this invention. 

[Drawing 2l It is drawing showing the concrete configuration of the signal 
transformation section shown in drawing 1 . 

[Drawing 31 It is drawing showing the concrete configuration of the input section shown 
in drawing 1 . 

[Drawing 4] It is drawing showing the concrete configuration of the filter arrangement 
in CCD shown in drawing 3 . 

[Drawing 5] It is a flow chart for explaining an operation of a configuration of being 
shown in drawing 1 . 

[Drawing 6] It is drawing for explaining how generating a reference image. 

[Drawing 7] It is drawing showing the process in which a lack pixel is restored based on 

a color edge model. 

[Drawing 8] It is the functional block diagram of the picture signal processor concerning 



the 2nd operation gestalt of this invention. 

[Drawing 91 It is drawing showing an example of the concrete configuration of the input 
section shown in drawing 8 . 

[Drawing 10] It is a flow chart for explaining an operation of a configuration of being 
shown in drawing 8 . 

[Drawing ll] It is the functional block diagram of the picture signal processor 
concerning the 3rd operation gestalt of this invention. 

[Drawing 12] It is the explanatory view of the filter arrangement in the input section 
shown in drawing 11 . 

[Drawing 13] It is a flow chart for explaining an operation of a configuration of being 
shown in drawing 11 . 

[Drawing 14] It is the functional block diagram of the picture signal processor 
concerning the 4th operation gestalt of this invention. 

[Drawing 15] It is drawing showing the concrete configuration of the signal 
transformation section shown in drawing 14 . 

[Drawing 161 It is drawing showing the concrete configuration of the filter arrangement 
in the veneer type CCD of the 4th operation gestalt. 

[Drawing 17] It is a flow chart for explaining an operation of a configuration of being 
shown in drawing 14 . 

[Drawing 18] It is drawing for explaining how restoring a lack pixel using a color edge 
model to the bottom of existence of chromatic aberration. 

[Drawing 191 It is the explanatory view of an example of filter arrangement of a veneer 
type image sensor. 
[Description of Notations] 

101 - The input section, 102 - The buffer for R signals, 103 - The buffer for G signals, 
104 - The buffer for B signals, 105 - The field extract section, 106 - The block buffer for 
R signals, 107 - The block buffer for G signals, 108 - The block buffer for B signals, 109, 
110, 111 [ - The edge on-the-strength calculation section, 115 / ~ The linear 
interpolation section 116 / The lack pixel restoration section, 117 / - The output 
section 150 / - The maximum distribution decision section, 151 / " Signal 
transformation section. ] -- The distributed calculation section, 112 - The buffer for 
reference images, 113 - The RGB change over section, 114 
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[Procedure amendment l] 

[Document to be Amended] Specification 

[Item(s) to be Amended] Claim 

[Method of Amendment] Modification 

[The contents of amendment] 

[Claim(s)] 

[Claim 1] 

In the picture signal processor which processes the picture signal with which the picture 
signal which one pixel has consists of two or more chrominance signals, and with which 
at least one or more chrominance signals are missing according to the location of a pixel, 
An extract means to extract the chrominance signal of the partial field of the 
predetermined size which includes the specified pixel from the above-mentioned picture 
signal, 

A chrominance -signal selection means to compute a predetermined parameter for every 
chrominance signal in the partial field extracted with this extract means, and to choose 
one chrominance signal based on this parameter, 

The deformation means which transforms a chrominance signal so that it may become 
the same as that of the parameter of the chrominance signal with which the 



above-mentioned parameter was chosen about chrominance signals other than the 
chrominance signal chosen with this chrominance -signal selection means, 
A candidate image generation means to compound two or more chrominance signals of 
each which deformed with this deformation means, and the" chrominance signal chosen 
by the above-mentioned chrominance -signal selection means, and to generate two or 
more reference candidate images, 

A reference image selection means to choose one reference image from two or more 
reference candidate images generated with this candidate image generation means 
based on a predetermined performance index, 

A restoration means to restore a missing chrominance signal based on the reference 
image chosen with the above-mentioned reference image selection means, 
The picture signal processor characterized by providing. 
[Claim 2] 

In the image input-process equipment which carries out input process of the picture 
signal with which the picture signal which one pixel has consists of two or more 
chrominance signals, and with which at least one or more chrominance signals are 
missing according to the location of a pixel, 

The input means which consists of an optical lens system which produces chromatic 
aberration, and image pick-up equipment with which the frequency of occurrence of a 
chrominance signal was adjusted based on this amount of chromatic aberration, 
An extract means to extract the chrominance signal of the partial field of the 
predetermined size which includes the specified pixel from the picture signal acquired 
from this input means, 

An approximation reference image generation means to generate an approximation 
reference image by transforming and compounding a chrominance signal with few 
amounts of chromatic aberration based on a predetermined structure model and a 
predetermined performance index in each chrominance signal in the partial field 
extracted with this extract means, 

A smoothing means to graduate the approximation reference image generated with this 
approximation reference image generation means based on the amount of chromatic 
aberration of a chrominance signal with many amounts of chromatic aberration, 
A restoration means to generate a reference image based on the approximation 
reference image generated with the above-mentioned approximation reference image 
generation means, and the approximation reference image graduated with the 
above-mentioned smoothing means, and to restore a missing chrominance signal, 
Image input-process equipment characterized by providing. 



[Claim 3] 

In the picture signal processor which processes the picture signal with which the picture 
signal which one pixel has consists of two or more chrominance signals, and with which 
at least one or more chrominance signals are missing according to the location of a pixel, 
An extract means to extract the chrominance signal of the partial field of the 
predetermined size which includes the specified pixel from the above-mentioned picture 
signal, 

A reference image generation means to generate a reference image by transforming and 
compounding each chrominance signal in the partial field extracted with this extract 
means based on a predetermined structure model and a predetermined performance 
index, 

A restoration means to restore a missing chrominance signal based on the reference 

image generated with this reference image generation means, 

The picture signal processor characterized by providing. 

[Procedure amendment 2] 

[Document to be Amended] Specification 

[Item(s) to be Amended] 0016 

[Method of Amendment] Modification 

[The contents of amendment] 

[0016] 

Moreover, the image input-process equipment concerning the 2nd invention In the 
image input-process equipment which carries out input process of the picture signal 
with which the picture signal which one pixel has consists of two or more chrominance 
signals, and with which at least one or more chrominance signals are missing according 
to the location of a pixel The input means which consists of an optical lens system which 
produces chromatic aberration, and image pick-up equipment with which the frequency 
of occurrence of a chrominance signal was adjusted based on this amount of chromatic 
aberration, In each chrominance signal in the partial field extracted with an extract 
means to extract the chrominance signal of the partial field of the predetermined size 
which includes the specified pixel from the picture signal acquired from this input 
means, and this extract means An approximation reference image generation means to 
generate an approximation reference image by transforming and compounding a 
chrominance signal with few amounts of chromatic aberration based on a 
predetermined structure model and a predetermined performance index, A smoothing 
means to graduate the approximation reference image generated with this 
approximation reference image generation means based on the amount of chromatic 



aberration of a chrominance signal with many amounts of chromatic aberration, A 
reference image is generated based on the approximation reference image generated 
with the above-mentioned approximation reference image generation means, and the 
approximation reference image graduated with the above-mentioned smoothing means, 
and a restoration means to restore a missing chrominance signal is provided. 
Moreover, the image input-process equipment concerning the 3rd invention In the 
picture signal processor which processes the picture signal with which the picture 
signal which one pixel has consists of two or more chrominance signals, and with which 
at least one or more chrominance signals are missing according to the location of a pixel 
An extract means to extract the chrominance signal of the partial field of the 
predetermined size which includes the specified pixel from the above-mentioned picture 
signal, A reference image generation means to generate a reference image by 
transforming and compounding each chrominance signal in the partial field extracted 
with this extract means based on a predetermined structure model and a predetermined 
performance index, Based on the reference image generated with this reference image 
generation means, a restoration means to restore a missing chrominance signal is 
provided. 

[Procedure amendment 3] 

[Document to be Amended] Specification 

[Item(s) to be Amended] 0018 

[Method of Amendment] Modification 

[The contents of amendment] 

[0018] 

Moreover, the image input-process equipment concerning the 2nd invention In carrying 
out input process of the picture signal with which the picture signal which one pixel has 
consists of two or more chrominance signals and with which at least one or more 
chrominance signals are missing according to the location of a pixel First, the 
chrominance signal of the partial field of the predetermined size which includes the 
pixel as which it was specified in the picture signal acquired from this input means is 
extracted using the input means which consists of an optical lens system which 
produces chromatic aberration in the above-mentioned image input-process equipment, 
and image pick-up equipment which adjusted the frequency of occurrence of a 
chrominance signal based on the amount of chromatic aberration. Next, an 
approximation reference image is generated by transforming and compounding a 
chrominance signal with few amounts of chromatic aberration in each chrominance 
signal in the extracted partial field based on a predetermined structure model and a 



predetermined performance index. Next, this generated approximation reference image 
is graduated based on the amount of chromatic aberration of a chrominance signal with 
many amounts of chromatic aberration. And a reference image is generated based on 
the generated approximation reference image and the~ graduated approximation 
reference image, and a missing chrominance signal is restored. 

Moreover, the picture signal which one pixel has consists of two or more chrominance 

signals, and in processing the picture signal with which at least one or more 

chrominance signals are missing according to the location of a pixel, the image 

input-process equipment concerning the 3rd invention extracts the chrominance signal 

of the partial field of the predetermined size which includes the specified pixel from the 

above-mentioned picture signal first. Next, a reference image is generated by 

transforming and compounding each chrominance signal in the extracted partial field 

based on a predetermined structure model and a predetermined performance index. 

And a missing chrominance signal is restored based on this generated reference image. 

[Procedure amendment 4] 

[Document to be Amended] Specification 

[Item(s) to be Amended] 0104 

[Method of Amendment] Modification 

[The contents of amendment] 

[0104] 

[Effect of the Invention] 

According to invention according to claim 1 or 3, a missing chrominance signal can be 
restored now with high precision. 
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so af77s5) , YEs<D®£ttxmmmm7i®i 1 



7 

[oo2 8] zLxwBwm 1 1 5*«aR«nfcwa' 

ffil 1 7fr£ttglWiJ2|-f 3 (Xf'y^S 1 6, S 1 
7) „ fcSHJR«7C»l 1 6A'aiRSn/"clg^{C 
ttffiftfMMlS 1 1 8*fl-LT#»JWJ»l 0 9, 1 1 

o, i i lc^fT-rs. T4t>-5, #&maau 09, 

110, 11 1 ttHfflffi 1 1 8tD$iJfflI«cS-^^. #7~n 
7^/^777 1 06, 1 0 7, 1 0 8 AOj0BflW4)& 

ft*fcOfifl«*i*j&r5 (Xf7^S6) o 
COO 2 9] flW&JBWl 5 KDSKdCl 5 1-A (0 
2 ) tt^gp 1 1 8 ©WWc»-3*, 1 

t§7D7^^777 1 0 6, 1 0 7, 1 0 8^« 

7). t4b^ §7*07^777 10 6, 10 7, 

tz>&\m&mt~£*\%z. t% uc^mmmm^v y 7 

1 1 2^tB*!2tt3c «*#H*©fefS*fT*&^fc©U:o 
^Ttt^y •/W7X»tBSPl 5 1 BtCttirtSnSo 

y^^'/WzxKtaaui 5 1 Bttxiiznrc&mmz 

T77S 8) , l^feil^I i:fct,K»JS35l 5 1 C\ 

ta^j-r^o iswm? 1 5 1 cttmastift^ya, t^ 
J7xp, tzm^x%&&im*$iBLT&mw@i'* 

777 1 1 2tctbTjT3 Ufy7S9) „ 

ttfctzm&it L<o&\m t mtzftfc&im t twm 
H&/W771 1 2\*>icmwzti%cti,c£t)mmm 

ft& (Xx-y^S 10), 

[0030] kmwmmfcffi l l 6 UIIIS; *«y 7 7 
1 1 2^6#8aa»*K*ttJUTa*»»%wrsfeffl 

^*»g**WWL Uf77S 11), YESOi^tt 

uto^mmm^tiiti^i 1 7{cfEsrs 0 no<d 
*^tt#saii«ffl/<'y7r 1 1 2?i<D&&£"ticmm 

lt§7D7^^777 1 0 6, 1 0 7, 10 8I*3<D5£ 

^?i«^fefi^ t *jt« u #fi(DMk«#fiffl^ad 

?%&?lcmBLT (Xx-y7S 1 2) , J±irjg|5l 1 7 

#!1H« i: nfc#psH® t &mw-$ nz ut7 
rs 1 3) o ttiaau 1 7fi«»^nfc#F.Sfflft^s 

tf«7t£ttfcfe{l^i: LTyl-^airj-rs ttf77*S 

1 4) „ 

[00 3 1] £<D£ : ?lCLT±$mm*m}zmy?tf 

MfcLit^&oic&fmm'ivyT 1 o 2, 103, 1 
0 4 rto-r^T<oH«*«3£SE?nTsaa«nsc: tic j: 
0 Uf77s 1 5) , 1 ~7i<-L ft comment 
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[0032] KTic ±&i,rc&m®mz*Ef$.tzij& 
^06 (a) ~ (j) z^mtrmmtZo *nmmn 

10 t#en§ 0 

[0 0 3 3] 16 (a) « (b) , (c) ttftlftl, 

= r, g, b) **-rHt?*«. Cft6<DSH»tfBl6 
(d) fcjfr£n.57*;I/*EB©C C DlC^oTS^^ 

(eK UK (g) K^"TJ:^4»flii:ft«o 
T\ 06 (e) , (f) , (g) CftfeflfO^^a 

20 (h) , (i), (j ) lC7jkZtlZ£ : jrj;m*trj:Zm 

[0034] *tc, a»©x.yj;«ia»*©*-e«t® 
T17 tauT, ci^x-v i/&m.ftm>b<D$><D 

ttfXZ 5. 

[0 0 3 5] cum ^fc^ROXyS/flBtfcJ&SL 

*#«LT-77'-7">'7>0«k3ftfffiiiiBBa*^«>» X-y 
tA 5 !^ t * 5 <t ? (dBffi WIC > a , , 

77. 0, %3R»3Cfcti#rLfc&BTti*<, t*n^ 

tr&z&mmz-o^x&m&itir, znuftv&mmc 
sffittoittt^x-y ^«BtA<ff en* j; 0 icmttZo 

[0 0 3 6] J-XTfC, V7 , 7i/7^*fffflil8ai: LT, 
[0 0 3 7] R, BfflJfoy-fVfcar , at iU 

50 J7xttp r , 0. t-rs. mmmmcstftZR. 



(6) 



9 

c, Brnmommmzixjio^thjufr , f g , 
m, , m» , m k -eat-to -vxtnmmtftf&t £l§ 



[0 0 3 
C»2] 



- [f r .m r( f b ,m b ] 



8] 



) m. 



+ f m =Mv + C 
8 s 
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(9) 



A 2 <D= | A 2 (Mv + C) | 
««/Wb-r*Ci:*^So v= [a, , ★ 

v= (A 2 M) "' (-A 2 C) 

R, Bim<D7^ya, . en t. 'UTZfir . /3b 

[0 0 3 9] lCT\ Ml4ID3tT5»J£l4fc6fcl\feiM$ 
SffiiMB{cS"^<!aittiS»tT5«J*»m-rS<e®^*S. $ 20 
fc, (11) SH:, Gft^tCR, B^*^t>-&*0>J-e 

[0 0 4 0] 07«\ ±ELfc*7— xyi^fOHc* 

fcO, 07 (b) tC^-T J: 3fi:CCD2 0 3 (AfiSB 1 
0 1) <D74fr2EMlO&bXE7 (c) , (d) , 

(e) fcKznz'moy&z&mtLTznznRm 30 

tffl/Vy7rl0 2, CMffl'W77l0 3, Bfs# 
ffl^777l0 4, Rt>*nS«fflt±i^l 0 5^MSLT, 
fnfnRi^ffl7ny^M7 7r 10 6, GfS^fflT' 
P-y^/Vy7r 107, B \%m%7u 7^/^777 1 0 

[0 0 4 1] cn5©fc8<Dfc4feflHt(i±iBLfcJ:o 
fCttttSltigRl 0 9, 110, 1 1 ltioTR#lHJ 

r c nicm<D{B%*&fr-&% (t&zftffl&m 150, 40 

{a*f£BSn 5 1) „ cc-ettGffi^©$Mfttf«*Eft 
5&<D£LT, R. BfifOW^fc/WT^ft 
5c 07 (f) , (h) tt±ffiLfc (11) SKflE^H 
ULft^Vo, , at t/W7Xp, . /3b tcJ;')^ 
JgLfcR. Bft^fc^U (g) fi*©3:*©Gfc9* 

[00 4 2] cne>07 (f) . (g) , (h) <Dffl» 

m hti% (#siffl/^7 7 7 ii2). ctDpmmm 

<Dfi, 7 77->7>fc<fcD3Rft;fcx<yy^*fU*rgqs 50 



SKA %JSU 

(1 0) 

★ /Jr , Cb , /?b ] ' H\ 

(1 1) 

GBW»g|5l 13H\ Sffl^ffl7D-y^777 1 0 
6, 1 0 7, 1 0 8rtOXSOfe«&S§ (H7 
(c) . (d) . (e) ) *MXffi&&LX^vi'®m 

swan 1 4T*x-yi/*&g£muu cn^soBBffl 

WiP^gRl 1 5(c&P>ttT. WKflHUc^oTllTcS 

n^o -7?, xsH3Ra7ca5 1 i e\tpmm»m^yy 
71 1 2fr$±t^Mmm<t>(D'f4ytsU7x*iii 

7XfC-S^^§ 0 Gfl^lC^fcHJT 
#B8ffij{£ 0 L T fc46, G ffi L T 
Hft<D©yf>i:/W7Xtt-S{LTV^ 0 ZtDfz&b, 

ztizmmt. 07 (j), (k) . (i) t^sns 

1 7Tmnt2>££X\ 0 7 (m) tc^n^^n 
[0 0 4 3] ±Etfc±5lc»i HSfg^cts^Tti, 
7-x -y s;* fvi/ £ 5 7"^ ->7 y icSo" < jgffil£?)§¥ffl 

x-y>?api:!pj»fsn*A^fcig«-tt, j§«©«jgffli 
ens,, 

[0 0 4 4] £43, ±|BLftfl«iJBffllrtfttJimiB«0-9- 

-rx*5 x 5 1 Lx^ztfz.tiicmmztiZi&miK 
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l & i> ct 5 ic i&mzir oT^stf, $111^ # p D mc & 

7-r X4 if fc <fc 5 A 7-x -y S^E-x/KaKgfcte*? # 

{dS^sns^iSK, g wefe So ft io 
[0045] msn^m^mzmmmmicm^mmm 

[0 0 4 6] 08ICfe^T« A7jS|33 0 1 liRffi^ffl/S 
777302, Gi§ffl^y7r3 0 3, Bfg#ffl/Vy 
77 3 0 4lcmffc2tl. §^fa^ffl^-y77 3 0 2, 3 
0 3, 3 0 4(i^tttilg|53 0 5^^LT^n^nRfl 20 
5§ffl7P-y7/W77 3 0 6, C (3^ffl7o -y 7/W 7 
73 0 7, Bfg*fffl7o-y*/W77 3 0 8fCjg^$tl 
Tl>3 0 RfB^i7P>y^A-y77 3 0 6CiR*t*§ffl¥ 
i3#&im^3 0 9hRCBWMlS3 1 7ttCg^S 
tl, C{i£fffl7P-y7/W7 7 3 0 7&C{§^ffl¥£l# 
l&1lffi^3 1 0£RGB^&^3 1 7ttC}g^£n, B 
{8#ffl7P-y7/W773 0 8&B{§^ffl¥i$£1&gtH 
SP3 1 1 £ R C B^g)53 1 7 ^{Cj&^ttTV^o 

[0 0 4 7] Rfl^ffl¥£l#lftSfcH£|53 0 9, GiS^m 
¥&l / mmtiii®3 1 0, B{I^ffl¥i35rtyStBg|5 3 1 1 30 

&it7v»f<{i«Kg[$3 1 2tcss!5nT^5o sa# 

fftfI^jiiJRgf$3 1 2*3i0RG BtfJ&g|5 3 1 7(i, fS^ 

^»gP3 1 3 t\mm{%$Lim3 1 4^lt, mm 

{|!ffl/W77 3 1 5(cS^^nTV>5o RCBWMI33 

1 7«sfc, ^H^ffgi53 1 8ic^mmst\r^ 

5 c f£}fH{0!ffl/W7 7 3 1 5 f±#,Wt^g|3 3 1 6 

Wg|5 3 1 6liy^Hir<t7Eg|53 1 8 fC&£!£nT^5c 
y^SiB^a7r:a5 3 1 8«:tB7jg|5 3 1 9 (cg^ftTt,-* 
5c 40 
[0 0 4 8] $fc, frJf9gT>3 2 Ofi, ATjgfl3 0 1 £, 
Hl«Bg|53 0 5 i:, R{f^ffl¥i^tfc»itiSf53 0 9 
i:, Gff^ffl¥^iiet±igi53 1 0t> Bft^ffl¥^ 

is»tugi5 3 1 1 aA^fi^^gi53 1 zt, mm 
mm£i&®3 1 4 1. mmmmiR^3 1 6 ^, rgb 

9J£g|53 1 7 y^S!MSg|53 1 8 t, tiitl^3 1 
9i:(c}g^$nT^5c 

[0 0 4 9] &*5, *^S6miT'{i±H2L/c§^cD- 
S)5(=;/^K7x7T«?n, A7Jgl53 0 1 liZiSC 
CDlc^D, tfi7jg|53 1 9(if8fi-rV7 7lCckD, WfP 50 
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g|53 2 0tiv^7nnyifa-^(c«}:»)ili^c$n5„ 
[0 0 5 0] ia9ti0 8tC^-rA7ja53 0 1 ©MftlWi 
/£<D-«^-f0T&5c 09{Ci5^T, U>X^4 0 

1 tGfI^fflP-/^7-r;U^4 0 2£G{§*ffflCCD 
4 0 4*5<i:tfR," B fI^fflP-/-?7. 7^/1/^4 0 3i: 
R, B{I^fflCCD4 0 5#tt¥ft£jf»TOci2B£ 
nT^5c Gf§fflCCD4 0 4ti, A/DgM§4 0 
6%^LTGfI^ffl/^y773 0 3tCgM$nT^5c 
Sfc, R, BiE^mC CD 4 0 5(i, A/Dgg|§§4 0 
7^R/B^gl[HlS§4 0 8^LTRf§^ffl/Vy77 3 

0 2 i:Bfl^ffl/Vy77 3 0 4(C^$nT^5c Gfl 
ffflCCD4 04 ^R, BfS*ffflCCD 4 0 5li, Gfl 
^fflCC DMeI5£4 1 OtR, Bfl^fflC C Dfg»[I] 

s§4 1 1 ^tc^n^tag^n, cfi^fflc c vrnm® 

S§4 1 Oi:R, Blt^fflC CDiggKUSS 4 1 1 tte, 7 
07?->"x*U-^ 4 0 9fre><D7n-y 7fCg'3VTG 
{i*ffl!CCD 4 0 4 R, Bfl*|fflCCD4 0 5 
&*ig®Tf5c 

[0051] J-XTte±,!2Lrcia8tc^-riiM£Dffffl^ia 

[0 0 5 2] $"T 1 7 )/-L.ft<D R G B 3 fl^ffiiJJ&g|5 
3 2 OCDifHJ8ltCJ;r>A7ja5 3 0 1 Sr/t-LTlfWASn 
T, RfS^ffl/^y77 3 0 2, G{§-^ffl/vy 77 3 0 
3, Bff^ffl/Vy77 3 0 4lC$mZft2> (Xf-yT'S 

2 1 ) 0 ^(C, m^tH^3 0 5«SiJffl953 2 0©$i|ffl] 
tcS^^TH®0^4^rf7oT (7r-y7S2 2) , S 
5 ^SiS*^^'^ t T 5 Rfr^^-r' X(7)^fl5tRi|?, fi»J* 
15X1 S+l-i'Xo^lllcrttcSffi-rsfi^fttiiLT 
(XT77S2 3) , ; e-n^'nRff^ffl7P-y7/^y7 

73 0 6, Gff^7P-y 7/Vy77 3 0 7, Bfl^ffl 
7P-y7/W77 3 0 8(cIe^-T5c R{l^m¥^»^ 

gffigi53 0 9, Gimm^mmwm^3 1 o, bis^ 

ffl¥^»i(SfcHg|5 3 1 1 (i*J®a5 3 2 O^JWCS-^ 
^fS^ffl7P-y7/^-y77 3 0 6, 3 0 7, 3 0 8 

[0053] m.-XftMmm$m3 1 2 a$ij?aigi5 3 2 0 

O$iJil(cSO'#^^g[gtti§I53 0 9, 3 10, 3 1 

1 T*Wtii-$tirc¥-£}£ft&<D?-ii, 3fefI^^ftA^ 
^^5fefi^WRtrf§^fBg(5 3 1 3{C$s&-f 
5 (Xf7 7S 2 4) „ $rc, R G B«j^g|53 1 7 t±$fj 
»»3 2 0<OSiJ{SI(cS-iif , &{§*fffl7P-y7/W7 7 

3 0 6, 3 0 7, 3 0 8 rtCD&ESW^fefSTOIfCS! 

*ajLT«^jg»3 1 3imtit%o \mmtU3 1 

1 7fr6!E2S;£tt5&fe<§*#fc:ov> 

S 2 5) , <5fe«^Wi1>OfelS#0«-« 

<*5«t-5{C^LT (7r-y7S2 6) , CtlWi 
ffl#4MgC3 1 4«^!|£Kif5 0 CCT\ 
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[oo5 4] 1 4 a, <s^g«a5 3 1 

7) . C*i5*fc*iBflWH>W7 7 3 1 5£f5£-f3o 

srs3 1 Gimmm 2 ooMwtis^t, iti7->*« 

mzmmmtLxmmbx (xxv7s2 8) , mn 10 
^s«:^SH^a^gP3 1 8tc^-5o xmmmwxM3 

1 8& #MHftSfttf 3 1 6*»60ai«IS*K#J6-r 
S#i£M&1Siffififtffl'W7:r3 1 57b>e.^ti3fo 
COW*tHLO»7», fc8SB3R«7C»3 1 8t±»g|5 
3 2 0 OiftiaiKSrJ*, RGB ^JJflgP 3 1 7 IC «t o TJi 
tC^m^nfcRM^ffl7n-y^/^y7r3 0 6, G<§ 
9ffl7D7^77 3 0 7, Bifffl7Dy*^y7 
7308 *<D&fe{§% ££ttT, ±8ELfcMI 1 

tmmic\m\mmm^'y7 7 3 1 5fr£M&ttiLft#!s 

H«*#ft€^»Cii^-rSJ:^k:a^LTta*aS3 1 9 20 
fceai-f 4 (Xx-y7S 2 9) o H173»3 l 9 il CD^ 

BtzrLrcPMm&ZMWLT (7t77*s3 0) . 

(Xf77S 31), 

[0 0 5 5] C<D£?lCLT±mmm*&&zru<y{7tf 
S«Lfclf\fc3lC&lg^JH/W77 3 0 2, 3 0 3, 3 

o 4 rtor^TOBfttfjtasftTjayisns c 1 k * * 



r 2 



[0 0 5 6] £§g)5M!cDJ:5(c-t§SCCD£ 
JfcWec^HWPtt G ff < , J -TXtcfc 5 

h«*$t r > b \m<r>>mttm.7tt % c t 

[0057] cotctb. *nMBm?'izRimm¥®ft 
®nm&3 o 9, Gffi^ffl¥J3#»mbBS3 io, bii 

*fffl¥*^ifcl[ttig|5 3 1 l(C43^TR. G, B<D30<D 

[00 5 8] \mmi^>3 1 3t±. G, BfI*f<D#ffto 
, . Ob t¥^AV g , AVb ^ R\m<DfttHo r t 
¥i^AVr fC fc*!><Q'7Vy a, , cu £/W 

[0 0 5 9] 
[&3] 



CI 



-«« J 



02) 



^ b =AV b (l-« b ) 



(13) 



(12), (1 3) 2KlC^£ft£«fc-5fC l-DCD&mmc 

fli*iBf§£j?5cg|33 1 4T'SJ, Rimt. iMf^y 
a, , at £/U7X0, . 0t (CcfcoT^^tl/c 2 

Bmm:*m&-£t>-&x. 4®<ommffi 
mmzsu&u cn*«jfa«ffl/w77 3 1 
?%o pmmmmn^3 1 6f±, ^y^/yici 1 )! 

TjM^-T^o c©2HRe*(i^«ii*«7cai5 3 l 8 fee 
[0 0 6 0] ±ELfcJ;5{c, MS2£figJB!|gfci3^TH: 



40 ffii^&#RSli«%g»?LT^«fi^*«7C-rs J: 3 1 
[00 6 1 ] &*5, *HaE0fi8T«-fiSC C D££ffl 

50 ¥^£I ; &fflv^T^§A' i cn^cll^^n5!K:^g^^a^ 0 fi^j^. 
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[oo6 2] hi i it*&m<DWi3nm&mic&zmm 
[0 06 3)011 tcfc^T, A^gP5 o i itRimm 

/Vy77 5 0 2, G{l^ffl/W77 5 0 3, Bffi*§ffl/S 
•y77 5 0 4(C}g^$n, #£{I*§ffl/W77 5 0 2, 
5 0 3, 5 0 4ltffiW1&ttiffi5 0 S^^-LT^-n^nR 
<l^ffl7n-y^>'W77 5 0 6, Gfi^^n-y^/W io 
77 5 0 7, Bimmya-y^^yyr 5 0 8fC*g|j?£ 
ntl^o Rfl^ffl7u-y^/^y7 7 5 0 6tiRfI^ffl 
«^«/J>StUai5 5 0 9 t R G B tfJ&gR 5 1 3 i: tc}f^£ 
n, G{f^tffl7n<y?/W7 7 5 0 7 ti G 
'hlWi^5 1 OtRGB$&g|55 1 3£fC&6!£ft, B 

\mm?u 7^777508 & B{i^ffl«*«>jvgttj 

pP5 1 1 i:RG B9J$g|5 5 1 3 tlcmmZftX^Z, 
[0 0 6 4] §{t^ffl»^S/jN»[tUg(5 5 0 9. 5 1 0, 
5 1 1 fi§*Uy^{8WRg|5 5 1 2lcmWcttlX^ 

5„ «*u<>>wiii}Rgi$5 1 mmwm&5 1 4 20 

*5<£Wt^g|55 1 Hcmc^tlXl^o RGB9J$ 

ass 1 3immw&$>5 1 4tcg^$nr^§o sas^ 
$355 1 4«, swim 5 1 5, ^.mmmmft^s 1 
6, (i^jggi55 1 nmmtiT^Zo mBm$&5 

1 5tifcb77g!5 5 2 3lcm%fZtlT^Z 0 iS^B^5 1 
7(i, *£ffiBHi£j£g|5 5 1 8%;f>LT, {gfSaftffl^-y 
77 5 1 9tc8$g£ftT^S„ fiffiBitffl/ i ;>y77 5 1 

9ti#^ia^jg|Rg(5 5 2 ot*%®mmjii&5 1 6tg 
^nxts d , tiiiMa! 5 2 o &xmmmmfc& 

5 1 6(Cg^$nr^5o ^SH^«7tgl5 5 1 6te, 1R 30 
^£$5 2 1 ZftLXB8tim±f&®5 2 2 £Hj7Jg|5 

5 2 3icmmznT^z>o mms^m^s 2 2«^s 
wmm^s 1 6{c^M$nrt/^ 0 

[0 0 6 5] mm&5 2 4 ti, A7}gP5 0 1 , m 

wmm&sos, R<mmm*:m>mm®5 0 9, cf§ 

^fflS*«'MiM5 1 0, B{f*tffl«*«'hStijgl5 5 

1 1, mKisyvtmrntRffls 1 2, rgb^&^s 1 
3. $asw&gP5 1 4, Ai§iM7cgi$5 1 6, mm 

1 8, #PSHff iM^g|5 5 2 0, m77g|5 5 2 3 
K|g£i£ftT^-5 0 40 

[0 0 6 63 4*, *mmBM?it±.ss.Lrz&®m<D- 

g|5{i^-K7x7T'fll^n, ^77^5 5 0 Hi#«^C 
CD .(H3#P,3) fCctt), ttJ77gf5 5 2 3 tifigSlTV 7.7 

(c<fcD, $WgP5 2 4(iv-r^nn>tr J .-^fc<tO^ 

[0 0 6 7] m 1 2 (a) , (b) iiA77gP5 0 UCt3 
tt-57^;l/^ES^*i*W^^-rHT^§ 0 
x-yv^-r/WckSfSTtti, £A77{i^£ffli^T#paH 
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[0 0 6 8] H(Dtctb. aiUjfiJBffi-p^LfciSlc, 
fcfct, j kx j kiMX 

[0 0 6 9] 01 2 (a) 14, R G B 3 fl^cM LT 6 
x6^X®g#EII©-0l*;SLTVS#* El 2 

(b) icK-?&?ic<i<Dm'bf i i#<D/w-y*m^rm 

$"f, < &Bffl$.<D*3:M.<OftM. (dx, dy), OSdx 
^jk, 0<d y < j k*(fiL^-r*¥Sr©n** 

•r^o RGB 3<B^©«-&tt3mWr5Ci:t^:0, 
&t>{3:0, 1, 2<D3'M t )t%?>c £<D&*)lC&&mSi 

[0 0 7 0] WTK±El/fcH 1 1 lC7?;-?mi$.<Dttm* 
mi 307n-^ + -h^#BSLTSiB^-r§c 

[0 0 7 1 ] 0 1 3 tfeVT, 17U— A#<DRGB3 
fi#jWM»8P5 2 4CD$iJ®£DSiCA7ja5 5 0 1 fcftLT 
8!&iA£ftT, R{I^ffl/Vy77 5 0 2, Gfl»fl|/W 
77 5 0 3, Bfif»^7 7 5 0 4fC|2i2£n£ (7 
41). fUHcttmSP 5 0 5t4$ijffllg|55 2 

4 2) , #61^777 5 0 2, 5 0 3. 5 0 4ft 

rtt#ffi-rs^*atilLT (7x-y7S4 3) , *n 
; e*nRff^7n>y7A-y77 5 0 6, Gfi*§ffl7o-y 
^777 5 0 7, Bi§ffl7"D7^W7r 5 0 8 t 
S2t5„ §7n7 7/^7 77 5 0 6, 50 7, 50 8 
rt©£j&fW#<9feH^f4H#, RGBW^5 1 3tC<fc 
5«»WWfc:8t5v>TfflaiBSiW5 1 4fcli52«nSo 
$fc, Ctli:[ilB#(CRm^ffl«Aa'J^Waig[55 0 9, G 
ffl^ffl«**/MWlSP 5 1 0, BfI^ffl«A»/jN»aigi5 

5 1 1 KfiaSSn*. $ijfflg|5 5 2 4t4, #«A«/Jn»W 
355 0 9, 5 1 0, 5 1 lStfSAl^>'>W^S55 

i zv<Dvmfi%7?&&v. &m®mffl5 1 4o»f^ 

^TOJ-TSo #«A»/hSHig|5 5 0 9, 5 1 0, 5 11 

4) , m±is yi/immtR& 5 1 2-\eiM$n-So *a 
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^i«5n Uf'^s 4 5) . 5 1 4 t{i 

[0 0 7 2] mmW®&5 1 »J»a55 2 4<Z>J?J 

uyvtmmvw® («iitfwiio~ i o 2 3<d 1 0 

frfcfflKL (Xf'yys 4 6) , Y E SOJgftttfeffB 10 

*(a7ca5 5 1 6«3hru No©Jt#«¥a^«si:w 

KLTa«ffiMS|J5 1 5£jgtR-T3o 
[0 0 7 3] »J&f|19ft5 1 5*3HRSnfc«^tt, & 

SP5 2 3^\ttl^-r§ (X-r-y 7°S 5 8, S 5 9) » £ 

g|5 5 2 4<D»J»fc:S-3£, fg%^g)5 5 1 7<DWmc® 

ntZa 1 7t'tt saa^a5 5 1 4^e> 

fr£fr£«L (Xf7^S4 7) , NOCD^I±C©*20 

Y = 0. 299R + 0. 587G 
(14) j£Tf#6tt*«fi£9Ytt» RGB 3 {1^5 
^fi8^nsfc46tc3f|^©{fP.o*^ajf(iiJ$tiTJ;t) 

»*fll*Y*tffc4#IBH«fcLT^*B*«7C»5 1 
6{CfcjM-r3 (Xf7yS 5 7) o ft&H#ft«7tgi5 5 1 

i iciE^-r^o iRmw^gp 5 2 1 2 0Bw»o«yi 
54) o cdT'iaffla, iiffl-rs^nS^^-rxKj: 

LfcfctDfcWKLT. «7C£ftfcfefI^££H;>3g|55 2 3 
f£ls2rrS (Xf7/S 5 5) o 
[0077] COJ; 9 fi LTigSJaa^JEJBISWjb'fia 
Lft^&olC&mmSrtyyr 5 0 2, 5 0 3, 5 0 4 

Ur'yyS5 6) , 1 7 U— .kttOBftKjtW'S'r^ 40 

[0078] ±&Lrz£?icm3nmmmic}s^ri*.. 
A-«/j>fi££-t>-£s c i: r^mmm £5£to, c <d#bsh 

0 , «t *) mtEitZtilt&fflB&tK- «fc -5 ffl7c^fT*>n 5 

», «k»)Kf«afta7cii»*^6n*. $rc, mm<r> 
u>wcm^mBffi®t(ommz.*fir>tctb, mm 50 
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<&*«fc 5 KgJBL Uf7 7'S4 8) , Cft£{£MS 

£/j!tg|5 5 1 8fcfejM5n5o 
[0 0 7 4] mm»£ims l 8, fl£ffiBi{iffl/W7 

r5i9, mMmmm^5 2 om ±Eb/i^2H 

SSJBffi t HUM) j?Bjfc «fc o ?ttft4>£ttB1K*£jft L 

®%mnLT!Kmmmm7z®5 1 6Keas-r« uf» 
t"s 5 0) o ^mmmm^s 1 6 it&&mmcm&+ 

5 =fc 5 K#5HB«*£ST S c i: (c i 0 ftjg Lfcfefl^ 
*«7cLTJMrr« Uf'yyS5K S5 2K 
[0 0 7 5] HK^|iJ^g|5 5 2 1 ttfflHOfcyiTi&SfrS 
fr%¥U/£L (Xx-y^S 5 3), »JIlI<D«iSTfe-5^ 

c{ia7c*nfcfefl^%ai*ftfc:»fs©^figai5 5 2 2 

iclEjM-rSo WKffi*|<lEJ*» 5 2 2 14, R G B 3 {3*ffr 
5WT©3*ffl^T»Sf^Yfcfe8-r5. 
[0 0 7 6] 

+ 0. 1 1 4 B (14) 

[0079] *nm&mT'im*imtm'Mm<D 

7-f;^EllcHLtt.Bi 2tc^^n5EIHcffiSJ 

[ 0 0 8 0 ] 0 1 4 fctfg 4 HiSS^ffitc^sia^A^saa 

[0 0 8 1 ] 0 1 4 tfcV>T, A7^gl56 0 1 ti, Rfl^f 
fflA777 6 0 2, Gl§ffl^777 6 0 3, Bfl^ffl 

/^-y776 o 4tcg^?n, $eac «l«}4ma56 0 5 

*M,Tf nf nRfifffl^n 7 ^;<!77 7 6 0 6, G 

776 0 8tlMJtlT^5. RWffl7D7^»;7 
76 0 6«^gmgi56 0 9£RC B^SP6 1 3 tfs 
^Jgg|56 5 ltC, Cfflfffl7ny^/W776 0 7(4 
#»*ffig|56 1 OtRGB^)g|g|56 1 3tfll#S«aP6 

5 UC, BM^ffl7n<y^/^y77 6 0 8fiRG B^JSI 
g|56 1 3lcmWf£ftT\,^ 0 »|R»Ha56 0 9» 610 
tt«**Hfti*£ffl56 5 0*^Lrffl%JB95 6 5 1 tc^ 

[0082] c©fli^sjBW6 5 1 immmmm^yy 
7 6ii i:ism#s8H®iifl?gi56 5 zz-ftLxkmwm 

S[7c»6 1 4(c}g^$n§i:i:t(c, #SgiS^ffl/ < v-y7 
76 11 i:¥?ifb^Sgl56 1 2*^LT^S5HSR«7ca5 

6 1 4C»«5«nT^5. jfi(tt#Mii^M^gi56 5 2 {4 
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¥ffi{tmm&6 i 2icfc»tt£nT^*. rgbw«s« 

6 1 3(4fcSB*«7tffl56 1 4 fcft]JIWSaS6 1 5 
J>LTtb7Jgfl6 1 6fC»«;JftT^4. flPj»ffi6 

1 7*4. atwo i , mmmta&e o 5, ^HRvua 
6 0 9, 6 io, sfiiBse 5 1 , fcimmmimiR 

96 52, RGB«$S56 1 3, K&BJRtt7cfl!6 1 
4, toS¥i^gf56 1 5, tti^g|36 1 6K:SfcSftT^ 

[0 0 8 3] 01 5tt±iELfcffi^£JB8B6 5 1 OUtt 
W*U***THTa&0, RB^»7B7^y7760 10 
6£, GS^fflrn-;^7776 0 7t, SAftStt* 
£356 5 Ot, SQ8lffi6 1 7frS©fl»*»t*WR« 
65 1 At, y^y/W7XStBai56 5 1 Bi, WiWffi 

6 5 1 c twmicmwtzriT^Zo 

[0 0 8 4] **«»ttT«:±Etfc*«(IB©- 
CDtCjcO, tiJ7Jgf56 1 6(i{Sax^7.^{C=t0, M0 
[0 0 8 5] 01 6 (a) -01 6 (d) &i, *$ffiflg 

aBoJWgac c Dic&uz? 4 >n>tmm<Dmftif}mi8.* 20 

*-r0T'fe-5„ CCT'fct, 016 (a) \C7fst&lft4 
xZcoV^fXt. 016 (b) fCTjrf £5&6 x 3CD-9" 
^XSr&fcElHt L, «:<*>«}: 54«*EH*Kfl[LTE 
g-fSCttCcfcDCCD ±©£iH3l £ 5t«-T 5 «fc 1 £ L 
TV5o 016 (c) £016 (a) £>g#E®££« 
LTEBL/cfcOT'fcO, 016 (d) f*0 1 6 (b) 

[0 0 8 6] 01 6 (a) cDS*EKT'ti R G B 3 fl*§ 

(Dtammmit3 •. 3 : 2, 01 6 (b) os*EBT»ii 
4:4:1 t.%%£?izmmztix^&o cn^nmm 30 

[0 0 8 7] crFK:±ELfcHI l 4 iCTHTm&LOim* 

[0 0 8 8] WT<OlMWetiA7jg|56 0 1 T'fflV^nS 
UvX^ttR, Gi§i:WLTliiRi«'jNT-S^ B 
H^lcStLTH:iRa38«**^e:i:*aS-r*. U 40 

-A#©RG B 3«^W»W6 1 7tD$Uffll(cSo"tA 
0 l*^LTK»iiStlT. Rff^ffl/S-y 77 6 
0 2, Gifffl^'y77 6 0 3, Bfi^fflA-y 77 6 0 
4(C$£££tt3 (Xr-y7°S6 1)„ nl^ttttig|56 0 5 

{i©ifflia5 6 1 7 oitwcg^t, aioiisffor 

(Xf7 7'S6 2) , MffflA'V77 6 0 2, 6 0 
3. 60 4 F*?<0 1 -7\s-kft<D&MEmp<b, 

wmz^&tTzmjzV'fxofeBmw. en*. if 7x7 
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6 3) , j enmRffl^ffl7n-y^/^y7 7'6 0 6, G 
{f^fffl7n-y^/W7 7 6 0 7, B{g*fffl7*D>y ^/W 

776 0 8tc<gas-r«. 

[0 0 8 9] R G BtfJ$g|56 1 3(i$JfflI&6 1 7 ©SfltH 
fCg-3£, §707^^7776 0 6, 6 0 7, 60 8 

gP6 1 4 teat-fa, ftigssr«^gi56 1 4&A7j£n 

fcftfll^©felRII«««** U^S*»*WW L T (7T7 
7°S 6 4) . At"/^^-(4X7 L >y7 P S 7 2lCffij+Z 9 

£{c7.-f-y7°S 7 2tC&firf£o b^X^tcfcf-f 
Sl(2M#'h£^R, GM^T-^§^±7.7 L -y7 B S 6 5 

[0090] ccT*5aa^Hiij»»6 1 7%^ur»»» 

tBg|56 0 9, 6 1 0fc£fTf*o -f&fctj, ftftgUffi 
6 0 9, 6 1 Ot±$iJ'<aig|5 6 1 7 COfiJWcgo'f , 
nS7n7^A*'y77 6 0 6, 6 0 7 rt<D&fe<I^*R 

feli^j^-rs (X7>y7°S 6 5) „ 
[00 9 1] \mm^& 5 1 <D®S?gP6 5 1 A (01 
5) BMIP&6 1 7<D$iJ®{Cg^t, g*#&jfc£g($6 

50^6 oee w«*»tt%wr a wf *»c «t o 

T#7O7^777 6 0 6, 6 0 7 rt©5e^«©* 
fefI^O-73^g«-T5 (7,f77S6 6) o £7u-y 
^777 6 0 6, 6 0 7ft<D ! fcBffiW<D&&iE J ^<Do 
^, 3 fe®^tt£fB;£ ft* c fcfc Lie 

#SBiffl' , ;777 6 i i^mrj$n?>„ eA^s^fe 

m^T&^&CDlc-D^TltV'f y • /W7XIW19J6 5 
1 B{Ctt}7j2ft£o • /Vf7X»MB6 5 1 Bti 

i fcfcJffflLT (X7-y7S6 7) , Sl£fe{f i; k 
K»WaP6 5 1 C\tU2rf *. MggP6 5 1 CtiSHi^ 

nfcy-r>oi t/U7xp< t^m^x^w^\m^ 

g^LT#Mi#/W77 6 1 l'MHTrTS (7f7 7 
S 6 8) „ **#«fc*ttS-rsgfBfcL0fe<g**fc£JB 

•y7S 6 9) o 

[0092] £&znrcm&<Dfiimmwmi¥mim 

SgP6 1 2feJ:0 : ifi{tt#.WfiM^gi56 5 2'\$£iM$n 
§0 3fifti#F.S,B<i^g|5 6 5 2 »^ 1 ^JfiSJ^jfitpsiatC 

x v i/&mcm^xmmwm{%*mR l uf77 

S 7 0) , ¥rt<b«!lilg|5 6 1 2 fcfcang*«7EfflS6 1 4 

'Nisasf 5o ¥?f{b5aagR6 1 2t±B<i^tcot,^T(Du 
wmmmm^fS.Lx'Knmmm.Ttm 1 4^^ 

f5 (T.x-y7S 7 1). 

[0 0 9 3] fc«H*«7cffi6 1 4J4RG B««8«6 1 
3*^LTS!*ii^R, G, BOfefl^^*., Bft 
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S 7 2) „ f-LT, c^ff^n/cfefi^i:3fi«#ESil 

mtzmnLT&Mwmzm (xt77s7 3) , c<d 

¥13356 l S'MEHTrs (Xx-y7"S 7 4) „ 
[0 0 9 4] C©«fc5fCLT±IMg*3§fl57ny*tf 
£«L*V\fc5Ji:&(g#ffl/W:77 6 0 2, 6 0 3, 6 

o 4 rt©-r^r©Bfs*^a$nTsaa$n5c * 
o (xf7ys7 5) , 1 7u-A5i-og{ftcw-r?,-r 

356 1 Sfcls&SnSo C<DtoS¥l^g|56 1 5{C(i, *g 

to©¥^6 1 5»cn6Ofei^i0»^LT (X 
f'V^S 7 6) . tiitl^6 1 B'MH^-r*. 
[0 0 9 5] 0 1 8 (a) ~B18 (o) it, feUXgco 

7EO*dtBBLTIKWr*. 01 8 (a) , (b) , 
(c) Jt^Wfft, RGB3fc#fc*JttSIRiS»©J£R 20 

sis (d) , (e) , (f) a^n^n, fe 

\s>XmT?M»Ztl1t t *<D R G B 3 \m<D 
'£<ttfM%7* ITI/^o £ £ X'ltmiCTTst «t 5 (C B fgSf 

018 (g) fc^snay-rrt/^EficDJiMRCC 

HI 8(h), (i), (j ) {CTj^tlS&WC&S,, 
[0 0 9 6] ClT\ $1 H9tttC< 01 8 

(h) CDRfl^Sa*, 018 (i) (OQ{m<DV^yt 

'W77>%Zn^tlffl&tnif, 01 8 (k) , 01 8 30 
(1) KjS£ft*S*W*xy^«jg;£WT3«»©# 

£&#!$B§! iitiS^^o LfctfoT, Cti^ffltt#I 
Bff i:ff^*o 

[0097] #fc, c©ififfii#!aa»%feiRigo»fc3t 

(SLTVHMk-rSCtT?, 018 (m) tc^"f ¥7iftjfi 

{tt#«Bfi^'f#?.n^„ co¥»fkifittt#BaH«tcs-3 40 

^TB<E^<F> J f'(>t/U7X*m&?2>££T'm 1 8 
(j) OBim<D%&*fi : j (018 (n) ) o 
T, ±»)Xyv;aS©/h«^g|l 8(1) <Difi(K#BgH 
ffi:, 018 (n) ©£J&£ftfcB<I#i:*£lfi'rSC 
£T, 018 (o) K^-r«J:a4a»Wft#B9H»A^ 

[0 0 9 8] ±S2LfcSS4£J&JBI8K:45^TM:, $1", 
feHXMcD'>S^fI^?rffli,>TifimW^#SBB^*'#5o 
* LT, C(D#Ha,Bf^¥!ffl:-r5ci:T*feitxMcD^^ 
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rg b 3m^<Dttim.mmw&wm 

[0 0 9 9] **5, ^HSg^ffiT'tiBfl^tCfellXM*^ 

<, im<Dmf§icttL-ct>m®icmw.tZ££ti i r'2 

(1) i ^<ommwmt%mmmi*fflk<r)&m^frz> 

(2) tm^mmmzusmm. ±,wg ; &7 : vi/i:LT 

x-y^f/^ffll^C t^tt^M (1) fcfE 
«©BMi^5QagB 0 

(3) 1 o<DlliPS^Wr«B«ffi^K»©fefi^6 
<#/S£n, a*offiiuc*5i;T'>4< fcfe i o«±o& 

m&z nrcmm<D&&im t ±K&fl»»R¥SK <fc o 

4fi!c-r5<i«jB^^¥gi:, C<D^MB^fi!c¥Sr- 

i o<o*jSiii»*aiR-rs#!Hia«a!iR#®i:» 
*fiFa t -r Bft fi^5aasHo 

(4) ±Eftfll*HR^eM3J:lf±E««¥Sa:» 

^-*i:LTffl^*Ci:%«fai:t*ffiiS (3) icEi! 
cDB^fi^jaagfio 

(5) - l 
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fC J* L 7 7*7 -> 7 > £fig L T f# £ ft -5 x -v ->*S£jg, $ fc 

ttfcfflt^SCfcfctfafcfSffijS (l) Sfctt (2) tc 

(5) -2 

t ft l v ~>7 t rf# e> ft 5 x -y ->*3£g, $ £ 
&*m^zz£*¥mfrzmi&. (3) (casKoBwi 

(6) -1 

OWKU 1JWU3) SE«<0±Efe«#aS^a*5<fctf 

arc#aK^stfs#*aftT5S«?*a*ffla.5« 

j£ (3) K£«®nfiM84§«19!SH. 

(6) -2 20 

owku (i) smniMBfflmmaEfi&eas* 

«j» U) Sfctt (2) tc£ttaBfltft9ftUi&ll. 
(6) -1 1 

ct-efrbftsiM (6) - 1 icmmvmBim&mm 30 

Ho 

(6) - 1 2 

c fcTfft>ft3«j« (6 ) - 2 fi^gg 

So 

( 7 ) ±mm<D&\m* , mfo*WLmz> c t Tits 

HoSffljRtt— 3<ofe®^k:*fJS-rsfe7-r/i'^*# 40 
»fc*4mx n tf-rx©£«{s«0g(r?«ia;*ft, ± 

RjESftTi^Sci:, £&&i:fS«fi£ (l) ~ (3) 

icmmcommxtiMmmo 

( 8 ) ±BltR0fe{B^*»^f**»»* 5 C t T-'ff s 

$fck*2W±«D«Ri:Lfci:t j kx j 50 
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snn^ci:, swat-rsflidt d) ~ (3) tcie 

(DWSMt j . $fc k * 2 J-X±<DgR£: L/c £ § j k x j 

x^zct, wmt-rzim en ~ (3) ksbk© 
HftA7jjaasSo 

do) ±sE«7c#att, ±ie#M^{cs^t«7t$ 

®i:-rs#,fi)c (l) ~ (3) EGtt0BflMi9ftllE& 

So 

(idi ooia**^-rsii«<i^^«»©feii^^ 

h £ § IS t » C (DAtl^mfr 5> if 6 ftfciHi 
■TSiii^A^gSo 

(12) ±IB£ftt#PSH(i4fi)c^a{i, ±IBtiii : &T r yb 

K^-^vis^TiXsK^zctik&WLttzmm. (i 

l ) {c!B«coBf|!A73«iilSSo 

(13) ±S2ffiffiMMHIffl«£fff^aHu -ttsrPfffiMSgti: 

-Jim, $ fctt^fefi^oiisftjstfw^ 6»ai $ 

x*;l/^-*fefix>hDe-Sfc(i*BBB*fctiJSBr- 

tttt*fctt«tt*fflv^s<it*«Fafc-rsfliB!t (id 
fcae«©H«A27*yi8ii, 
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B. ±!2Lfc»j« (1) ~ (1 3) IC~D^T<D mWff 

mmLHott^mm] imTwmx&Zo 

flifiJt (1) , (2) , (5) — 1 , 2 

*sflisca7c-r * £ ^-5 jstcoir^rwffir s c t #t- 

m-3 £ KSf 5 fefI^S«ffl{C«7cT 5 c t ttx £ 5 
B«e*t*yiSH*ffi 0W" 3 c i: £ BW £ f S„ 
Affile (3) , (4), (5) -1,2, (6) -1, 10 
2, 11, 12 

mmimzmmmmx. &mm^%mm§ 

m& (7) , (8) , (9) 

• -r * &ffl9%iftfli*tc«7t-r s c i: # t 1 5 sift fs^sa 

M(10) 

<M (1 1) , (12), (13) 

ttfctzcttfx2%\,\ *awic©^»c»gu h 

«fl)«liiSt-r;l/*feiRgfc:a-3#¥jtfb-rs*'PKfliift 40 

c. ±sebfe«ia (i) ~ (i 3) ico^rco rwjs-r 

«« (1) , (2) , (5) -1, 2, (6) -1, 
2, 11, 12, (7) 
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«03<DCCD2O3*^, CiDCC D2 0 3 (Cfcnt 
«fi7w/l/*©£|18MEI!«m. n*3tt±08»i:t 

nr^-5„ «nsttKDtttB¥att, 0 1 t^^nsiswa 

tHgfl 1 0 5£#fc 0 «fig*©#!SiIH*£jS#a«\ 0 l 
04MWWtt»i 0 9, lio, ill, «*#&»£gf5 

15 0, \ 5 1 , 7 r 1 1 2 

%^ty<, efig^-r/l^L-Oi, #Rtf?f&©fe{i^tf[i] 

T 7 7^ s/ 7 y L Tt# £ ft 3 x -y s?atg, $ 
fed^OiggK^T^iJ^ 6 HtB $ ft § x*;l/*- $ fc it 

m^&o «Jff*0«7c¥Sti* a!K¥ST*SH l ©x 

y$>uut»a«i 1 4*5j;awnragi5i 1 5, kmm 

m&TX&l 1 6*^€fo X.y^SS»mgPl 1 4t±0J;t 

s^tcs^t^ffiRsgp i i 5 tk%mmmfct$ 1 1 6 

[0 10 0] d<D^©»$LV^fflWiaT©fflOT 
£3o 01, 03, 0 4 fC/Tx-T ATjgfll 0 lfr6<DH« 
fs^ ; &R{I^fflA-v77 10 2, GfS^ffl^-y7r 1 0 

3, Bfl^f77io4KT«#u fHwaawi 

0 5 JCTBfiglM X©fc«©fe£^*ttm LX R ffl^ffl 
7n-y^-y77 1 0 6, Cf§ffl7n>yi'M777 1 
07, B{I^J87D-y ^^7 7 7 1 0 8{C$ra£-f£„ x 
•y^aSJMiasl 1 4(i, RfWD7^777l 
0 6, GfI^ffl7n-y^/<:-y7r 1 0 7, B{f^ffl7a 
9^777 1 0 8*©£fe£^XyS^SfiK:S-J 
t, ttuftjffiflfti l 52>\ *fct±fc£Iijl5«7E»l 1 6 

o^ifK(cj;?)xsH^a7cbTai^a5i 1 7^e 
jn-r^o ^SHjR«7ca5i i 6^HR?tifti^iai, 
\mm&m\ 5 1 «, «A^i*^a5i 5 o*eo«* 
^ajcBB-rsnsiBtcs^^T, 06toT,r*7-x-yy 

Wlffi^»; 7 7 1 1 2 ft 3 c i: T-#SM{i 

6^fi!c5ft§. ^«H3R«7C»1 1 6 tt0 7 {C^fJ; o 

\c&mmmcm^x'Knmmit'&7iLx\h-h%> \ 7^ 

MC & % m.n.ftWRZ ft fcif^tC ti * ^-X -y i/* 

t ;i/*>e.#p.aBiff **fig l, c <D&mwm & 6 

T^*J flfjg^xVUci^aTcti, 5X5-15X15 
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imvazft ? <fc 3 tc -r s c t t% vsmtoismc. ^mt 

ffJS (3) , (4) . (5) — K 2 
«^iliR#8tt» H8<ORflt^ffl^fMR»ma5 3 0 

BtB§P3 1 1 , m±ftmmmiR?$3 1 2£#ty a io 
tpoa«?ati» H8©e^sjB»3 1 3£#i? 0 ttm 

08<D<£*iB{gt£f£g|$3 1 4*#ty. ttA 
*©#BaiS«a!S?#att, H8<D#Milftilftfl:3 1 6 

fctixy h n £-£fcU:fflllli:£&^Hi1$££fi1f 20 
353 1 8*#tf 0 

[0 10 1] COWWOJffSbtSBfflWttWTflMi!)"? 
£3 0 08, H9£^-fAftffi3 0 lfr&OHflHt?* 
3 0 2, G{f*fffl/W77 3 0 3, B 
ifffl/V>7 7 3 0 4fCT<£#U Hi£ttffig|53 0 5fC 
TffiSlM X<Dffi®<D&im*mtii L T R ©#ffl7"a -y 
^777 3 0 6, GfPtffl7*n-y^/<;-y77 3 0 7, 
Bfi^ffi7*n>y^/^v77 3 0 8^\te^-r§ 0 Rfl^fffl 
¥^«-»J¥aa5 3 0 9, G®-^ffl^»{R»ta«5 3 1 30 
0, Bfi^ffl¥^«WtH»3 1 ltt#@§17ny* 
^777 3 0 6, 3 0 7, 3 0 8 F^cO^feff #^St*m 

§153 1 3 fiC 5 feffl4§©¥i9fc#» 

t-ar * J; ^ tc c M3:fr<D&mz%mZo mum 
1 4(i«7vo»S(^x.sfefi^^^$n 

x-y->*aats^#ioo#!!aii«*3iiRL, ^sbis 40 
tern. cti5<o&e^*ia*^t)-a-T*jsB«o«ffi* 
c k t x -y 1 mm? % c t (c <fc o r sw« so 
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enmmmmt. 5x5-1 5x1 smm^it 

flftf (3) , (4) , (5) — K 2, (6) — 1 , 
2, IK 12, (8) , (9) , (10) 

2W±«D»»4:Lfei:*»c, j k x j k +M X<omBffi 

$ae# 2 w± j *?s £ & s «t 3 tiBgsn*. * fctt, 

LfcfctK j k x j ktf'f X©Jg}g«tt®fi«T'«iaS 

£ to^n* j ms tfc t %<om 

*E*3i,vrW£S*i*. 1SfiK^©}fim¥©«, 01 1 

01 lORffi^ffl«*«/J4ltt»5 0 9, Gff 
^ffl«*«/M(ffiSP5 1 0, B<8^ffl«*H/h!¥ttias5 
1 U «*U>^flJ^aSS?ffl5 5 1 2^#ty c *j«tfOS 
0 1 1 5 1 7?:#€y 0 «uu#a 

feet xsm^mt, &&\m<Dm.±m*> «t D : «'J^^i^cs 

mmt, 01 10«tfflift£J«S5 1 8^r#ty 0 ®& 

tfnmsmmKR^euts 01 i<o#sgB«a»?«5 2 
7 77->7 y^ss-r ^ t <t 0 f# ?> n s x >?ara$ fc 

li^feffl^OSJtft^T^J^^iftH^nsx^^^-S 

1 <D^S«iS!g(5 5 1 4Rl>\ «U^ffifflS|S5 1 5, ftgffl 
^'*7t;g|5 5 16, IR^W^SP 521, »e{i#4^g(5 5 

2 2£$t? 3 Saa^]g|g|5 5 1 4«^JAif, I7->*M$ 

MF^8P5 1 5^^gH^a7ca5 5 1 6t4«0«ilS. 
feffl^6»Kfll^*flfeJ«U, iRJUW^as 5 2 ltt±E 

[0 1 0 2] C©«W©»SLV , 3SfflWlttWTOii»)"P 
0 1 1 fC^-T AftSG 5 0 1 ^e>©B<ffI^R{I 
^777 5 0 2, Glfffl^777 5 0 3, Bfl# 
I'W77 5 0 4{CTfS#-T5o M^tttii^5 0 5(im 
X©ffl«Ofe«^*ffla LT Rfl^ffl7*n y ^ )\ 
7775 0 6, CB§ffl7ny^77 5 0 7, Bfl 
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*t/B7a-y*/W77 5 0 8*^UTRO^ffl«*«/jN 
gtt|gi55 0 9, Gfll^ffl«^«/M(ai»5 1 0, Bff^f 

i^ti'j^stujn, «*u>->watRW5 1 2 

ETl^OUyi? (=**ffi-«/MB) £-^*.3fefi# 

rcitxmmmmft&5 1 6«?n ( lUBMntf s 1 
5 bmm tiitmtt^<mj&mic ± 0 
«7c$ntti^gi5 5 2 3^\$EHi$n5„ ^sia^«7ca5 5 10 

1 6^i«^n/ci^(i, ismgtfs 1 7 fern*© 

C©ffi©fe{§*t£MU ^B<»£JS9S5 1 8(CTS 
to-B-S c t «fc o TiKft4)£}lffift*£j£ U 
§lO0#!aSMHfit§ 0 XSffli^«7cg!5 5 1 6 {4 

2 1 tteHifSo «RjtE¥J^aB5 2 1 ttwiuosaao^ 

M0©ffi7c£nfcB{t!£©l©;i&*tffi© 2 

2 3^15311- So 

^l^LT, C©fe{§^f;: ffi©fefl*t*gjg 30 

Silitx-y '>*au8tcStJ*aiR-r* c iitcio rim 
tfTtS. C<D#!KB«{i, 5 x 5~ l 5 x l 5gJt© 

E^TS$©£{f^£^T£/£$ns/c46, hs^e 

i)S(ll), (12), (13) 

±gSLfc^4aissMc^-r5o *rt*©Aa¥« 
01 4©A^»gP6o i^r#cfo m^(omm^m 
its mi 4c*$n5fg«Hamsp6o 5%#«y 0 tutf* 50 
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0ifi(M?l!Hli«4/S?8tts m 1 4 ©#&lflijg|56 0 
9, 6 10, SA$HRtt£tf 6 5 0, fi*t£fl5«6 5 

Xltm*. t£ , *g&©fefi^tf [b]-©x >y ->'/ - 

L T ti$J A. ti\ £fefc*(c *f L X 5 75 S/7 > £S&f c 

£ tC <fc <0 m 6 n§ X -y ->*®JS, $ /cl±&fe{t*t©fijgft 

mfcw&ftmm. m\ ACD'mmmm.Tt^Q 1 4, 

WPE)g|56 1 5£#& 0 

[0 10 3] CO«WO»*L«/^JBfflWt4WTOiiDr* 
&3o 01 4 fcitfE 1 6 tC^I" A7jgfl6 0 1 tyt><Dm 
»if*Rfi§ffl^-y7r6 0 2, Gfi^ffl/N*-y7r 6 
03, Bm^ffl/Vy77'6 0 4KT«St*. M^ffltii 
g|56 0 5fim£-9-WX©ai«©ftfll#*ttWLTRffl^ 

6 0 7, B^ffl7n-y*/*«y77 6 0 8'Mg2!1"So 

iMRilffl»6 0 9, 4MWiaiSP6 l Ofi&^rR. G©fe 
fi^feofefg^^^-rSo «^^Jgg|56 5 l itm±(D 

l 2 tic©i£ftt#SBB^feiRMa{<:So^T¥ri{b-r 

So ^SB^«7cgP6 i 4ir&{mmwmt¥ffiit-$n 

Bff{cS^t^B^«7c-r-5o toS¥^gI3 6 l 5fi 

i e^ii^-rso 

(ftffl) eiRg«Kj5i;Tfeffl^oas»K^HSsn 

ft^^fiScL, -7?, c ©ififtt#P.a,B#*feiRMa©f- v > 

&t z> n t X'&mMmz&ib, c ©#BB,B^*>e^sa 

i:T-*§3i^xrt'£jgffl-f£o C0)fci6«»Wtti-r^T 
©feffl^*fflV>T#HgB® WajSSnSC ^tc^:0, ft 
»£&fc«fe©«7ctfRrffiKfcS. $fc, fe4XM©feS 

i:(*© n x h ^rfgM-r S C t #T* * 5 „ 
[0 10 4] 
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[0 10 5] »*JS2Cffi«0»WKJ:ntf. £ 

[0 i ] *%W<Dm l Slt)6Si:||«fWI9fiffill 
O$Fi7n-y?0T*;fc£o 

CE3] 01 K*-rx*aJo*f*w«j«%^-rHt?* 10 

[04] H3fc^rccD<c:l3t*&7<rA'*EII4>R{t 

[05] 0HC^-r^(Of / Fffl^^1-§fci6cO7o- 
f-r-hT'&So 

[06] mm{m±mttm*mw?%tctb<Dmx* 

[0 7 ] #7-X-y ^txrt/fcS^TfcSiBjRjbHlTL 

[08] *m$<Dmznm&mmzmmmw!mm 20 
[09] mic7n?xti®(vm&ftmfc<D-m*7K-tm 

[010] H8»c^-rfl|jSOffffl«SiW-rSfei6<07n 

[011] *igB«co^3ii)}sm^c^5i®^fi^j!aas 

BcO^"7"u-y^0Tfe-5o * 
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* [01 2] 01 nc^-rA^g|5fi:t5tt57-c;!/^E§<39 

[01 3] 01 nc*-r*ia©ffffl*ittwi-5fe4i>o7 

[014] *g$Q*4&fflgMKft«HMWl& 

[0 1 5] 0 1 4 K**ffi*g©»OJ|ttW«jS***- 
0T&3 O 

[016] »4HJ(HBS80*«SCCDtfettS7-f;l/ 

[01 7] 01 4ic*tmi$.<D{mzmwtz>rcib<D7 

[01 8] feiRMOSffiTfcfel/^T^^-x-y^r^ 

[01 9] JWSa»K?©7^;I/*EBO-iHOKiH 

10 1-Aft», 10 2-Rflfffl/W77, 10 3- 
Gifffl/^y7 7, 10 4-Bfi§ffl/^y77, 105 
---flMtttUft 10 6-Ri§IB7Dy^y77, 1 

0 7-GltM7Py^777, 1 0 S-BiE^m7 
Dy^/W77, 10 9, 110, lll-#ifcKtH 
SB, 1 1 2-#Hiffl/^y77, 1 1 3-RCB«» 
SP, 1 1 4-X7^MIffl^ 1 1 5---ffiBttH& 

1 1 6»-fcasiBjis*73S5, 1 1 7-a*», 1 so -a 

1 5 1 ■■■WMBflSo 
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